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(54) Solid-state image sensing apparatus, control method therefor, basic layout of photoelectric 
conversion cell and storage medium 



(57) An object of this invention is to provide a solid- 
state image sensing apparatus capable of performing 
high-precision AF and AE without adding any camera 
mechanism or increasing power consumption. To 
achieve this object, at least S1 and S2 among photoe- 



lectric conversion cells output signals not for forming an 
image signal in a solid-state image sensing apparatus 
in which photoelectric conversion cells for converting an 
optical image formed by an optical system into an elec- 
trical signal are two-dimensionally laid out. 
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Description 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

[0001] The present invention relates to a solid-state 
image sensing apparatus, a control method therefor, an 
image sensing apparatus, the basic layout of a photoe- 
lectric conversion cell, and a storage medium. 

DESCRIPTION OF THE RELATED ART 

[0002] In recent years, needs for processing images 
in computers are abruptly increasing. To meet this, 
many digital cameras for capturing an image into a com- 
puter are now available. Along with the development of 
such digital cameras, digital still cameras for processing 
still images tend to increase in the number of pixels. 
Cameras having an image sensing element.of 800,000 
pixels (XGA class) are spread though general moving 
image (video movie) cameras have an image sensing 
element of 250,000 to 400,000 pixels. Further, cameras 
having 1 ,000,000 pixels to 1 ,500,000 pixels are becom- 
ing popular. For high-end devices of an interchangeable 
lens type, cameras using a megapixel image sensing 
element having 2,000,000 pixels, 4,000,000 pixels, or 
6,000,000 pixels are commercially available. 
[0003] I n the video movie camera, the camera photo- 
graphing system such as the AF and AE of a camera is 
controlled using output signals successively output from 
an image sensing element at a video rate. For this pur- 
pose, AF adopts TV-AF (hill climbing method or contrast 
method). 

[0004] To the contrary, the digital still camera adopts 
various methods depending on the number of pixels and 
the camera operation method. Generally in most of dig- 
ital still cameras of a 250,000- or 400,000-pixel class 
used in the video movie camera, repetitive readout sig- 
nals (images) from a sensor are displayed (to be re- 
ferred to as a finder mode or EVF mode) on a color liquid 
crystal display (a TFT liquid crystal display of about 2 
inches is recently often used) mounted on the camera. 
Thus, the digital still camera operates basically similarly 
to the video movie camera, and employs the same 
method as the video movie camera. 
[0005] However, in a digital still camera having an im- 
age sensing element of an 800,000-pixel class or more 
(to be referred to as a megapixel digital still camera), the 
image sensing element in the finder mode operates ac- 
cording to a driving method of thinning out signals as 
much as possible, except for those from signal lines or 
pixels necessary for display on the liquid crystal display 
in order to increase the finder rate (close to the video 
rate). 

[0006] In a high-grade digital still camera having 
1 ,000,000 pixels or more, the time from depression of a 
release switch to photographing must be short in order 



to meet need for instantaneously photographing a still 
image similarly to a silver halide camera. 
[0007] For these reasons, the megapixel digital still 
camera adopts various AF and AE methods as follows. 

(1) AF 

(a) The digital still camera employs an AF sen- 
sor in addition to the image sensing element. 
The AF sensor is of a phase difference type, 
contrast type, rangefindertype, active type, like 
the silver halide camera. 

(b) The digital stiil camera uses an output from 
the image sensing element itself. In this case, 
the image sensing element is of a hill climbing 
type or phase difference type using a signal 
from only a specific region of the image sensing 
element (signals from this region are not 
thinned out) because a long time is spent for a 
read from all the pixels of the image sensing 
element, and distance measurement does not 
require information of all the pixels. 

(2) AE 

(a) The digital still camera employs an AE sen- 
sor in addition to the image sensing element. 

(b) The digital still camera uses an output from 
the image sensing element itself. 

[0008] However, the conventional megapixel digital 
still camera suffers the following problems. 
[0009] As for AF, the digital still camera having an AF 
sensor in addition to the image sensing element re- 
quires a lens system for forming an image on the sensor, 
and a mechanism for realizing a corresponding AF 
method (for example, the active method requires an in- 
frared generator, projection lens, light-receiving sensor, 
light-receiving lens, and infrared projection moving 
mechanism, and the phase difference method requires 
an imaging lens to a distance measurement sensor and 
a glass lens for causing a phase difference). This in- 
creases the camera size and cost. Further, AF using the 
image sensing element itself suffers many error factors 
such as the difference in path between an optical system 
for the image sensing element and an optical system for 
the AF sensor, a manufacturing error in molded mem- 
bers for forming these respective optical systems, and 
an error caused by temperature expansion. These error 
components are larger in the digital still camera of the 
interchangeable lens type than in a digital still camera 
of a permanent lens type. 

[0010] Considering this situation, demands have aris- 
en for digital still camera of another AF type which uses 
55 an output from the image sensing element itself. Of the 
AF methods, the hill climbing method is disadvanta- 
geous in a long in-f ecus time. The present applicant pro- 
poses a method of arranging a mechanism of moving 
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pupil positions to positrons symmetrical about the optical 
axis in a lens system for forming an image on an image 
sensing element, and calculating the defocus amount 
from the phase difference between images formed via 
the pupils, thereby adjusting the locus of the lens (Jap- 
anese Patent Laid-Open No. 9-43507). This method re- 
alizes high-speed, high-precision AF (for AF, the signal 
readout time is short because signals are read out from 
several specific lines in the image sensing element 
whereas the signals of the remaining lines are cleared 
at a high speed.) However, this method requires a mech- 
anism for moving the pupils, resutting in large volume 
and high cost. 

[001 1] This also applies to AE because the digital still 
camera having an AE sensor in addition to the image 
sensing element requires a mechanism for the AE sen- 
sor. Jo use signal charges from the image sensing ele- 
ment itself, the image sensing element must be driven 
for photometry a plurality of number of times by chang- 
ing the stop diameter or shutter speed because of a 
small dynamic range of the image sensing element. This 
increases the time before actual photographing, and se- 
rial movement of the stop increases power consump- 
tion. 

SUMMARY OF THE INVENTION 

[0012] The present invention is concerned with solv- 
ing the above problems, and an embodiment provides 
a solid-state image sensing apparatus capable of per- 1 
forming high-precision image sensing adjustment (lor 
example: AF and AE) without adding any camera mech- 
anism or increasing power consumption, a control meth- 
od therefor, an image sensing apparatus, the basic lay- 
out of a photoelectric conversion cell, and a storage me- 
dium. 

[001 3] A solid-state image sensing apparatus accord- 
ing to a first aspect of the present invention has the fol- 
lowing arrangement. 

[0014] That is, a solid-state image sensing apparatus 
in which photoelectric conversion cells for converting an 
optical image formed by an optical system into an elec- 
trical signal are two-dimensional ly laid out is character- 
ized in that at least some of the photoelectric conversion 
cells output signals not for forming an image signal. 
" [001 5] A solid-state image sensing apparatus accord- 
ing to a second aspect of the present invention has the 
following arrangement. 

[001 6] That is, a solid-state image sensing apparatus 
having an image sensing region where photoelectric 
conversion cells for converting an optical image formed 
by an optical system into an electrical signal are two- 
dimensional ly laid out is characterized in that the image 
sensing region is defined by repetition of basic layouts 
of photoelectric conversion cells for detecting a plurality 
of colors, and one photoelectric conversion cell in at 
least some basic layouts of the image sensing region 
outputs a signal not for forming an image signal. 



[0017] The basic layout of a photoelectric conversion 
cell according to the present invention has the following 
layout. 

[0018] That is, a basic layout of a photoelectric con- 
s version cell in a solid-state image sensing apparatus 
having an image sensing region where photoelectric 
conversion cells for converting an optical image formed 
by an optical system into an electrical signal are two- 
dimensionally laid out is characterized in that photoe- 
10 lectric conversion cells for detecting a plurality of colors, 
and photoelectric conversion cells for outputting signals 
not for forming an image signal are combined. 
[0019] A solid-state image sensing apparatus accord- 
ing to a third aspect of the present invention has the fol- 
is- lowing arrangement. 

[0020] That is, a solid-state image sensing apparatus 
in which photoelectric conversion cells for converting an 
optical image into an electrical signal are two-dimen- 
sionally laid out is characterized by comprising a first 
20 photoelectric conversion cell for outputting a luminance 
signal for forming a two-dimensional image, or a signal 
for generating a luminance signal and chrominance sig- 
nals, a second photoelectric conversion cell for output- 
ting a signal other than the luminance signal or the signal 
25 for generating the luminance signal and chrominance 
signals, and switching means for switching a first read 
mode of reading out a signal including both the signal 
output from the first photoelectric conversion cell and 
the signal output from the second photoelectric conver- 
ge sion cell, and a second read mode of reading out a signal 
including not the signal read out from the second pho- 
toelectric conversion cell but the signal read out from 
the first photoelectric conversion cell. 
[0021] An image sensing apparatus according to a 
3S first aspect of the present invention has the following 
arrangement. 

[0022] That is, an image sensing apparatus is char- 
acterized by comprising a solid-state image sensing el- 
ement in' which photoelectric conversion cells for con- 

40 verting an optical image into an electrical signal are two- 
dimensionally laid out, the solid-state image sensing el- 
ement having a first photoelectric conversion cell for out- 
putting a luminance signal for forming a two-dimension- 
al image, or a signal for generating a luminance signal 

45 and chrominance signals, and a second photoelectric 
conversion cell for outputting a signal other than the lu- 
minance signal or the signal for generating the lumi- 
nance signal and chrominance signals, a timing gener- 
ator for generating a driving signal to the solid-state im- 

50 age sensing element, the timing generator generating a 
first driving signal for outputting, from the image sensing 
element, a signal including both the signal output from 
the first photoelectric conversion cell and the signal out- 
put from the second photoelectric conversion cell, and 

55 a second driving signal for outputting, from the image 
sensing element, a signal including not the signal read 
out from the second photoelectric conversion cell but the 
signal read out from the first photoelectric conversion 



3 



5 EP 0 981 245 A2 6 



cell, and switching means for switching a first photo- 
graphing mode of generating a video signal using all pix- 
els on the image sensing element by the first driving sig- 
nal, and a second photographing mode of generating a 
video signal by thinning out the pixels on the image 
sensing element by the second driving signal. 
[0023] An image sensing apparatus according to a 
second aspect of the present invention has the following 
arrangement 

[0024] That is, an image sensing apparatus is char- 
acterized by comprising a solid-state image sensing el- 
ement in which photoelectric conversion cells for con- 
verting an optical image into an electrical signal are two- 
dimensionally laid out, the solid-state image sensing el- 
ement having a first photoelectric conversion cell for out- 
putting a luminance signal for forming a two-dimension- 
al image, or a signal for generating a luminance signal 
and chrominance signals, and a second photoelectric 
conversion cell for outputting a signal other than the lu- 
minance signal or the signal for generating the lumi- 
nance signal and chrominance signals, a thinning circuit 
for thinning image signals every predetermined time, 
and switching means for switching a first photographing 
mode of generating a video signal using all pixels on the 
image sensing element, and a second photographing 
mode of generating a video signal by abandoning sig- 
nals output from the second photoelectric conversion 
cell by the thinning circuit, and thinning out the pixels on 
the image sensing element. . 

[0025] A solid-state image sensing apparatus control 
method according to the present invention has the fol- 
lowing steps. 

[0026] That is, a solid-state image sensing apparatus 
control method of controlling a solid-state image sens- 
ing element having a first photoelectric conversion cell 
for outputting a luminance signal for forming a two-di- 
mensional image, or a signal for generating a luminance 
signal and chrominance signals, and a second photoe- 
lectric conversion cell for outputting a signal other than 
the luminance signal or the signal for generating the lu- 
minance signal and chrominance signals in a solid-state 
image sensing apparatus in which photoelectric conver- 
sion cells for converting an optical image into an elec- 
trical signal are two-dimensional ly laid out is character- 
ized by comprising controlling to switch a first read mode 
of reading out a signal including both the signal output 
from the first photoelectric conversion cell and the signal 
output from the second photoelectric conversion cell, 
and a second read mode of reading out a signal includ- 
ing not the signal read outf rom the second photoelectric 
conversion cell but the signal read out from the first pho- 
toelectric conversion cell. 

[0027] A storage medium according to the present in- 
vention has the following control program. 
[0028] That is, a storage medium storing a control pro- 
gram for controlling a solid-state image sensing element 
having a first photoelectric conversion cell for outputting 
a luminance signal for forming a two-dimensional im- 



age, or a signal for generating a luminance signal and 
chrominance signals, and a second photoelectric con- 
version cell for outputting a signal other than the lumi- 
nance signal or the signal for generating the luminance 
s signal and chrominance signals in a solid-state image 
sensing apparatus in which photoelectric conversion 
cells for converting an optical image into an electrical 
signal are two-dimensionally laid out is characterized in 
that the control program comprises a code of the step 
*0 of switching a first read mode of reading out a signal 
including both the signal output from the first photoelec- 
tric conversion cell and the signal output from the sec- 
ond photoelectric conversion cell, and a second read 
mode of reading out a signal including not the signal 
15 read out from the second photoelectric conversion cell 
but the signal read out from the first photoelectric con- 
version cell. 

[0029] An image sensing apparatus according to a 
third aspect of the present invention has the following 
arrangement. 

[0030] That is, an image sensing apparatus is char- 
acterized by comprising an image sensing region where 
photoelectric conversion cells for converting an optical 
image into an electrical signal are two-dimensionally laid 
out, the image sensing region including a plurality of 
photoelectric conversion cells for outputting signals for 
generating image signals, and second photoelectric 
conversion cells for outputting signals not for forming an 
image signal. 

[0031] Other features and advantages besides those 
discussed above shall be apparent to those skilled in 
the art from the description of a preferred embodiment 
of the invention which follows. In the description, refer- 
ence is made to accompanying drawings, which form a 
part hereof, and which illustrate an example of the in- 
vention. Such example, however, is not exhaustive of 
the various embodiments of the invention, and therefore 
reference is made to the claims which follow the descrip- 
tion for determining the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0032] 

Figs. 1 A and 1 B are views each showing the basic 
pixel layout of a solid-stage image sensing appara- 
tus according to an embodiment of the present in- 
vention; 

Fig. 2 is a view showing a pixel layout including a 
distance measurement pixel in the solid-stage im- 
age sensing apparatus according to the embodi- 
ment of the present invention; 
Figs. 3A and 3B are a plan view and a sectional 
view, respectively, showing the structure of a pixel 
for detecting the first phase in the solid-stage image 
sensing apparatus according to the embodiment of 
the present invention; 

Figs. 4A and 4B are a plan view and a sectional 
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view, respectively, showing the structure of a pixel 
for detecting the second phase in the solid-stage 
image sensing apparatus according to the embod- 
iment of the present invention; 
Figs. 5A and 5B are views for explaining the princi- s 
pie of detecting a focus shift in the solid-stage image 
sensing apparatus according to the embodiment of 
the present invention; 

Fig. 6 is a view showing another pixel layout includ- 
ing a distance measurement pixel in the solid-stage to 
image sensing apparatus according to the embod- 
iment of the present invention; 
Fig. 7 is a view showing still another pixel layout in- 
cluding a distance measurement pixel in the solid- 
stage image sensing apparatus according to the is 
embodiment of the present invention; 
Fig. 8 is a view showing still another pixel layout in- 
cluding a distance measurement pixel in the solid- 
stage image sensing apparatus according to the 
embodiment of the present invention; 20 
Fig. 9 is a view showing photometric pixels in the 
solid-stage image sensing apparatus according to 
the embodiment of the present invention; 
Fig. 1 0 is a view showing a region having a distance 
measurement pixel in the solid-stage image sens- 2S 
ing apparatus according to the embodiment of the 
present invention; 

Fig. 11 is a view showing the structure of the solid- 
stage image sensing apparatus; 
Figs. 12A, 12B,:and 12C are views each showing 30 
the basic pixel layout of a general region in the solid- 
stage image sensing apparatus; 
Figs. 13A and 13B are views showing the pixel 
structure of the solid-stage image sensing appara- 
tus; 35 
Figs. 14A and 14B are views showing another pixel 
structure of the solid-stage image sensing appara- 
tus; 

Fig. 1 5 is a timing chart showing the image read tim- 
ing of the solid-stage image sensing apparatus; 40 
Fig. 1 6 is a timing chart showing the distance meas- 
urement/photometric data read timing of the solid- 
stage image sensing apparatus; 
Fig. 17 is a view showing the concept of detecting 
the focal point in the first embodiment; <s 
Fig. 18 is a view showing the concept of detecting 
the focal point in the first embodiment; 
Fig. 19 is a graph showing an image shift in the first 
embodiment; 

Fig. 20 is a view showing a focus detection cell in so 
the first embodiment; 

Fig. 21 is a view showing a light-shielding film; 
Fig. 22 is a view showing the arrangement of an im- 
age sensing element in the first embodiment; 
Fig. 23 is a view showing the arrangement of an im- ss 
age sensing element in the second embodiment; 
Fig. 24 is a view showing the operational concept 
of a vertical transfer CCD in the second embodi- 



ment; 

Fig. 25 is a timing chart showing a vertical transfer 
pulse in the second embodiment; 
Fig. 26 is a timing chart showing the vertical transfer 
pulse in the second and third embodiments; 
Fig. 27 is a view showing the operational concept 
of the vertical transfer CCD in the second embodi- 
ment; 

Fig. 28 is a timing chart showing the vertical transfer 
pulse in the second embodiment; 
Fig. 29 is a view showing the operational concept 
of the vertical transfer CCD in the second embodi- 
ment; 

Fig. 30 is a timing chart showing the vertical transfer 
pulse in the second embodiment; 
Fig. 31 is a view showing the operational concept 
of the vertical transfer CCD in the second embodi- 
ment; 

Fig. 32 is a timing chart showing the vertical transfer 
pulse in the second embodiment; 
Fig. 33 is a block diagram showing an example of 
the arrangement of an image sensing apparatus in 
the fourth embodiment; 

Fig. 34 is a flow chart showing processing of the 
image sensing apparatus in the fourth embodiment; 
Fig. 35 is a view showing the arrangement of an im- 
age sensing element in the third embodiment; 
Fig: 36 is a view showing the operational' concept 
of a vertical transfer CCD in the third embodiment; 
Fig. 37 is a timing chart showing a vertical transfer 
pulse in the third embodiment; 
Fig. 38 is a view showing the operational concept 
of the vertical transfer CCD in the third embodiment; 
Fig. 39 is a timing chart showing the vertical transfer 
pulse in the third embodiment; 
Fig. 40 is a view showing the operational concept 
of the vertical transfer CCD in the third embodiment; 
Fig. 41 is a timing chart showing the vertical transfer 
pulse in the third embodiment; 
Fig. 42 is a view showing the operational concept 
of the vertical transfer CCD in the third embodiment; 
Fig. 43 is a timing chart showing the vertical transfer 
pulse in the third embodiment; 
Fig. 44 is a flow chart showing processing of the 
image sensing apparatus in the fourth embodiment; 
Fig. 45 is a flow chart showing processing of an im- 
age sensing apparatus in the fifth embodiment; and 
Fig. 46 is a block diagram showing an example of 
the arrangement of the image sensing apparatus in 
the fifth embodiment 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0033] Preferred embodiments of the present inven- 
tion will be described in detail with reference to the ac- 
companying drawings. 
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(First Embodiment) 

[0034] A basic pixel layout in the first embodiment of 
the present invention will be described with reference to 
Figs. 1A, 1B, 12A, 12B, and 12C. Figs. 1Aand IBshow s 
the pixel layouts of an image sensing element. Figs. 
12A, 12B, and 12C show general pixel layouts. 
[0035] The pixel layouts shown in Figs. 1 2A, 1 2B, and 
12C will be explained. Each pixel layout is the color lay- 
out of a basic unit portion in an area sensor having 2 io 
pixels x 2 pixels as a basic unit. Fig. 12A shows a Bayer 
layout, and Fig. 12B shows a Bayer layout applied to a 
complementary color filter. The layouts in Figs. 12Aand 
12B will be called a primary color Bayer layout and com- 
plementary color Bayer layout, respectively. Fig. 12C « 
shows a layout including G in addition to three comple- 
mentary colors (G-including complementary color lay- 
out). 

[0036] Another known pixel layout is a complementa- 
ry color checkered layout in units of 2 pixels x 4 pixels, 20 
and this checkered layout is most often used in a video 
movie camera sensor The present applicant proposes 
a complementary color checkered layout in units of 2 
pixels x 8 pixels (Japanese Patent Laid-Open No. 
9-46715). 2$ 
[0037] The color layout in units of 2 pixels x 4 pixels 
or 2 pixels x 8 pixels is predominant for an area sensor 
which processes a moving image (interlaced-scanned 
video image). However, for a camera which processes 
a still image, the color layout in units of 2 pixels x 2 pixels 30 
can simplify signal processing and attain a high-quality 
image. The following description will exemplify an area 
sensor having the color layout in units of 2 pixels x 2 
pixels, but the present invention can also be applied to 
an area sensor having the color layout in units of 2 pixels 35 
x 4 pixels or 2 pixels x 8 pixels. 
[0038] A basic pixel layout in the first embodiment will 
be described with reference to Figs. 1 A and 1B. Fig. 1 A 
shows a primary color Bayer layout, and Fig. IB shows 
a complementary color Bayer layout or G-including <o 
complementary color Bayer layout. 
[0039] In Figs. I A and lb, reference symbol S denotes 
a functional sensor cell for reading out distance meas- 
urement data for AF or photometric data for AE. By form- 
ing pixels functioning as AF and AE sensors in an image 
sensing element itself, the sensor of the first embodi- 
ment can achieve distance measurement for AF of the 
camera or photometry for AE using a- signal read out 
from the image sensing element itself. This realizes 
high-precision AF and AE. Also, the photometric time is so 
short, unlike a conventional AE sensor using a signal 
from an image sensing element itself. This arrangement 
can eliminate any mechanism necessary for an addi- 
tional sensor, thus realizing a compact, low-cost cam- 
era, ss 
[0040] A pixel for detecting distance measurement 
data for AF and an area sensor having this pixel in the 
first embodiment will be described. 
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[0041] As the image sensing element of a megapixel 
digital still camera, an interline CCD or full-frame CCD 
is mainly used. The interline CCD is often used in a low- 
end camera having an optical system of 2/3 inches or 
less, whereas the full-frame CCD is often used for a 
high-end camera having an optical system of 1 inches 
or more. The greatest difference between the interline 
CCD and full-frame CCD is that the former can read out 
sensed signal charges even if light is incident on the im- 
age sensing element, but the latter can read out signal 
charges only after closing a mechanical shutter at- 
tached to the front surface of the image sensing ele- 
ment. 

[0042] As a solution for the full-frame CCD, the 
present inventor has already proposed an improved full- 
frame CCD having a storage section for storing charges 
of a small number of lines between the image area of 
the full-frame CCD and a horizontal CCD, and a partial 
read driving method for AF and AE when the mechanical 
shutter, is open. The present inventor has also proposed 
a method of reading out AF/AE signal charges at a high 
speed from only a necessary portion in an image area 
in an interline CCD (i.e., a method of clearing unneces- 
sary signal charges at a high speed). These proposi- 
tions allow the interline CCD and the (improved) full- 
frame CCD to read out signal charges from a region in- 
cluding a distance measurement/photometric pixel ar- 
ranged in the image area within a short time without re- 
petitively opening and closing the mechanical shutter. 
An embodiment using the improved full-frame CCD will 
be explained, and the present invention can also be ap- 
plied to the interline CCD. 

[0043] Fig. 11 is a view showing the structure of an 
improved full-frame CCD area sensor. 
[0044] Reference numeral 1 denotes an image area 
which has pixels in m rows x n columns (horizontal and 
vertical lines will be respectively called rows and col- 
umns), and is made up of n photosensitive vertical 
CCDs (V-CCDs). 

[0045] In general, each V-CCD is made from a 2- to 
4-phase driving CCD or a psuedo 1 -phase driving CCD 
such as a virtual phase CCD. <X>VI is a pulse for transfer 
from the CCD in this region. (The type of applied pulse 
changes depending on the type of V-CCD such that one 
type of pulse is applied to the pseudo 1 -phase driving 
CCD, and two types of pulses are applied to 2-phase 
electrodes in the 2-phase driving CCD. This also applies 
to the storage section and horizontal CCD, and only one 
pulse signal is illustrated for descriptive convenience.) 
[0046] Reference numeral 2 denotes a partial storage 
area for storing signal charges from arbitrary o columns 
among the n columns of the image area. The o columns 
can store signal charges on several percentages of the 
n columns. Hence, an increase in chip area of the image 
sensing element by the memory section is very small. 
<DVS is a pulse for transfer of the CCD in this region. 
This region is covered with an aluminum light-shielding 
layer. 
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[0047] Reference numeral 3 denotes a horizontal 
CCD (H-CCD) for receiving signal charges photoelec- 
trical^ converted by the image area 1 in units of rows 
and outputting them to an output amplifier 4. 0>S is a 
transfer pulse for the H-CCD 3. 
[0048] Reference numeral 4 denotes the output am- 
plifier for converting signal charges of each pixel trans- 
ferred from the H-CCD 3 into a voltage signal. The out- 
put amplifier 4 is generally a floating diffusion amplifier. 
[0049] Reference numeral 5 denotes a horizontal 
drain formed between the H-CCD and a channel stop 
(drain barrier, not shown) to remove unnecessary 
charges. The signal charges of pixels in a region unnec- 
essary for a partial read are removed from the H-CCD 
to the horizontal drain 5 via the channel stop. Instead, 
an electrode may be formed on the drain barrier be- 
tween the H-CCD and horizontal drain, and the applica- 
tion voltage may be changed to efficiently drain unnec- 
essary charges. 

[0050] In this arrangement, a small storage region is 
added to a general full-frame CCD to realize a partial 
read from an arbitrary location. 
[0051] The pixel structure will be explained by exem- 
plifying a virtual phase for descriptive convenience. 
[0052] Figs. 1 3A and 1 3B show the pixel structure of 
the image area, in which Fig; 13A is a plan view, and 
Fig. 13B is a view showing a structure taken along the 
line A - A' and the potential profile. 
[0053] In Figs. 13Aand 13B, reference numeral 201 
denotes a clock gate electrode which is formed from 
light-transmitting polysilicon and has a lower semicon- 
ductor surface serving as a clock phase region. The 
clock phase region is divided into two regions by ion im- 
plantation. One region is a clock barrier region 202, and 
the other is a clock well region 203 formed by ion im- 
plantation so as to exhibit a higher potential than the 
clock barrier. 

[0054] Reference numeral 204 denotes a virtual gate 
formed from a p + -type layer on a semiconductor surface 
to fix the channel potential. This region serves as a vir- 
tual phase region. This region is also divided into two 
regions by implanting n-type ions into a deeper layer 
than the p + -type layer. One region is a virtual barrier re- 
gion 205, and the other is a virtual well region 206. Ref- 
erence numeral 207 denotes an insulating layer formed 
from an oxide film or the like between the electrode and 
semiconductor; and 20B, a channel stop for isolating the 
channels of the respective V-CCDs. 
[0055] Although not shown, the pixel structure addi- 
tionally has a function of preventing blooming which 
causes charges to overflow as a pseudo signal to an 
adjacent pixel when strong light is incident. The typical 
method is to form a lateral overflow drain. 
[0056] More specifically, a drain made of an n + -type 
layer is formed adjacent to each V-CCD, and an over- 
flow drain barrier is formed between the overflow drain 
and charge transfer channel. Charges exceeding the 
overflow drain barrier are removed to the drain. The 



height of the drain barrier is fixed by ion implantation, 
and changed by forming an electrode (over drain barrier 
electrode) on the overflow drain barrier and controlling 
the value of a voltage (VOD) applied to the drain elec- 
5 trode. 

[0057] In transfer from the V-CCD, an arbitrary pulse 
is applied to the clock electrode 202 to increase/de- 
crease the potential of the clock phase with respect to 
the potential of the virtual layer, thereby transferring 
charges to the H-CCD (in Fig. 1 3B, '-O' represents 
movement of charges). 

[0058] The pixel structure of the image section has 
been exemplified, and the pixel structure of the storage 
section is also the same. In the storage region, however, 
the top of the pixel is covered with the aluminum light- 
shielding layer, blooming need not be prevented, and 
thus no overflow drain is formed. The H-CCD also has 
a virtual phase structure, but adopts the layout of a clock 
phase region and virtual phase region so as to allow re- 
ceiving charges from the V-CCD and horizontally trans- 
ferring them. 

[0059] A color filter is formed on the CCD cell of the 
image section shown in Fig. 11. A metal light-shielding 
layer for preventing mixture of respective colors is inter- 
posed between the color filter and CCD cell. Figs. 14A 
and 14B show the structure. 

[0060] Reference numeral 209 denotes a protective 
layer on a semiconductor surface; 210, a metal layer for 
preventing color mixture, which may be formed from a 
black layer of the same material as the color filter; 211 , 
a smoothing layer for smoothing a surface on which a 
color filter layer is formed; 2t2, a color filter layer of pri- 
mary or complementary colors; and. 21 3, a protective 
layer for protecting the filter layer. 
[0061] Fig. 2 shows a layout when a distance meas- 
urement pixel for AF is formed on the full-frame CCD. A 
line having a plurality of functional pixels S1 and a line 
having a plurality of functional pixels S2 are arranged 
side by side in a normal Bayer layout. 
40 [0062] The pixel structures of S1 and S2 will be de- 
scribed. 

[0063] Figs. 3A and 3B show the pixel structure of S1, 
in which Fig. 3A is a plan view, and Fig. 3B is a sectional 
view taken along the line B - B\ This pixel does not have 

45 any filter layer, and its top is covered with a microlens 
216. Reference numeral 215 denotes a smoothing layer 
which smoothes a surface for forming the microlens and 
corresponds to the protective layer 21 3 of the color pixel 
(the smoothing layer 215 is formed in the same step as 

so the protective layer 21 3). The feature of this pixel is that 
a light-shielding layer having an opening offset (decen- 
tered) from the center of the photoelectric conversion 
area of the pixel is formed on the same surface as the 
light-shielding metal layer for preventing color mixture 

55 jn the color pixel. 

[0064] Fig. 4B is a sectional view showing the struc- 
ture ol S2. S2 has an opening offset from the pixel center 
by the same distance as S1 in an opposite direction. 
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[0065] In an area sensor having 1 ,000,000 pixels or 
more, the rows of S1 and S2 are regarded as almost the 
same line in the layout of Fig. 2, and an approximate 
image is formed on their microienses. If the camera lens 
for forming an image on the image sensing element is 
in an in-focus state on the image sensing element, an 
image signal from an S1 group on an S1 -including row 
coincides with an image signal from an S2 group on an 
S2-including row. If the focal point is before or behind 
the imaging plane of the image sensing element, the im- 
age signals from the S1 and S2 groups on the S1- and 
S2-including rows have a phase difference. The phase 
differences in the near-focus state and far-focus state 
have opposite directions. 

[0066] This is theoretically the same as the above-de- 
scribed pupil division phase difference AF in Japanese 
Patent Laid-Open No. 9-43507. When the camera lens 
is viewed from the photoelectric conversion portion of 
S1 and the photoelectric conversion portion of S2, the 
pupil seems to be divided into right and left parts with 
respect to the optical center. 

[0067] Figs. 5A and 5B are views showing the concept 
of an out-of-focus image shift. In Figs. 5A and 5B, S1 
and S2 are united as points A and B. For descriptive 
convenience, color pixels between functional pixels are 
omitted as if the functional pixels were aligned. 
[0068] Light from a specific point on an object is split 
into a light beam (<DLa) incident on the point A via its 
pupil, and a light beam (<DUb) incident on the point B via 
its pupil. Since the two light beams are originally emitted 
from one point, they should reach one point on the same 
microlens (Fig. 5A) if the focal point of the camera lens 
is adjusted to the image sensing element. However, if 
the focal point is before the arrival point by a distance 
x, the light beams shift from each other by 20x (Fig. 5B). 
If the focal point is before the arrival point by a distance 
-x, the arrival point shifts in an opposite direction. 
[0069] Based on this principle, if the camera lens is in 
an in-focus state, an image (signal beam by the light 
intensity) formed by the A line and an image formed by 
the B line coincide with each other; otherwise, shift from 
each other. . 

[0070] The image sensing element according to the 
first embodiment is based on this principle to assemble 
pixels having microienses with different opening posi- 
tions into a basic layout, and to define a region where 
the row of a basic layout including pixels (S1 ) having the 
first openings is arranged adjacent to the row of a basic 
layout including pixels (S2) having the second openings. 
A shift between row image signals from the S1 and S2 
groups in this region is calculated to obtain a shift of the 
focus of the camera lens, and the lens of the camera is 
moved to eliminate this focus error, thereby realizing 
autofocus. 

[0071] The region having the distance measurement 
pixels of the S1 and S2 groups need not be set on the 
entire image sensing area or over all rows. For example, 
distance measurement regions suffice to be buried at 
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several points, as shown in Fig. 10. 
[0072] When a distance measurement signal is to be 
read out from the image sensing element, the charges 
of only a line including the distance measurement signal 
5 are read out, and the remaining unnecessary charges 
are cleared at a high speed. 

[0073] The image capture mode of the improved full- 
frame CCD, and the partial read mode for a read from 
a distance measurement region will be described with 
io reference to the timing charts of Figs. 1 5 and 1 6, respec- 
tively. 

[0074] In normal photographing using the sensor in 
Fig. 11, a mechanical shutter attached to the front sur- 
face of the image sensing element is closed. The pulses 
is <dvi, <DVS, and OS are applied at a high speed to per- 
form clear operation of removing charges from the im- 
age area and storage area to the clear drain 5 (Tclear). 
[0075] The numbers of pulses <1>VI , C>VS, and <DS cor- 
respond to n+o or more transfer V-CCDs. The charges 
20 in the image area and storage area are removed to the 
clear drain via the horizontal drain and floating diffusion 
amplifier via the H-CCD. In an image sensing element 
having a gate between the H-CCD and horizontal drain, 
the gate can open only during the clear period to effi- 
25 ciently remove unnecessary charges. 

[0076] The mechanical shutter is opened immediately 
upon completion of clear operation, and closed upon the 
lapse of a time for obtaining a proper exposure amount. 
This period will be called an exposure time (or storage 
30 time) (Tstbrage). During the storage time, the V-CCD 
stops (<X>VI and <DVS are at low level). 
[0077] Signal charges generated in accordance with 
light incident on the sensor surface (image light formed 
into an image on the sensor surface via the imaging lens 
35 before the sensor) are accumulated in the virtual well in 
each pixel. When the charge amount increases to ex- 
ceed the overflow drain barrier, subsequent charges are 
removed to the overflow drain. Since the storage section 
is shielded from light, each pixel is vacant without any 
40 signal charges. 

[0078] After the shutter is closed, signals charges on 
o lines are vertically transferred (Tern). This operation 
transfers signal charges on the first line (line adjacent 
to the storage section) of the image area to the first line 
45 (line adjacent to the H-CCD) of the storage section. The 
first o-line transfer is continuously performed. To clear 
charges in the H-CCD before transferring the charges 
from the first line of the image area to the H-CCD, the 
charges of all the lines of the H-CCD are transferred 
so (Tch). This removes charges left in the H-CCD in the 
clear period (Tstorage) of the image section and storage 
section, and the charges of a dark current accumulated 
in the H-CCD during the clear period (Tern) of the stor- 
age section. 

55 [0079] After the storage section is cleared (this is read 
set operation of transferring signals from the first line of 
the image section to the final V-CCD adjacent to the H- 
CCD), and the H-CCD is cleared, signal charges in the 
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image section are sequentially transferred from the first 
line to the H-CCD to sequentially read out the signals in 
units of lines (Tread). The readout signal charges are 
converted into digital signals, which undergo image sig- 
nal processing by a pre-processing circuit made up of a 
CDS circuit, amplifier circuit, and A/D conversion circuit. 
[0080] A partial read for AF of the digital camera using 
this sensor will be explained with reference to the timing 
chart of Fig. 16. 

[0081] In general, the full-frame sensor separately 
comprises AF and AE sensors because the shutter must 
be closed during transfer. To the contrary, the sensor of 
the present invention can read out part of the image sec- 
tion at once or repetitively while the shutter is kept open. 
[0082] First, signal charges on o lines (no lines) at ar- 
bitrary locations in the image area are stored in the stor- 
age area, and preceding-area clear transfer for remov- 
ing charges on the (o+nf) lines is done to drain signal 
charges in the preceding image area (nf) of the arbitrary 
o storage lines (Tcf). Then,, signal charges on the no 
lines are stored in the storage area 2 during the storage 
period (Ts) before the preceding-area clear period Tcf. 
[0083] Immediately, the H-CCD is cleared to drain 
charges left in the H-CCD upon the preceding-area op- 
eration (Tch). After that, signal charges in the no lines 
of the storage section are transferred to the H-CCD in 
units of lines and sequentially read out from the output 
amplifier (Tr). Upon completion of a read of the signals 
in the no lines, all the lines of the image sensing element 
are cleared (Tcr) to complete a high-speed partial read. 
By similarly repeating this operation, a partial read can 
be continuously executed. In the above-mentioned 
method of performing AF by measuring the phase dif- 
ference between formed images, signal charges are 
read out from several portions in the image area for the 
purpose of an AF read. Instead, for example, signal 
charges are repetitively read while changing locations 
such that a signal is read out from an H-CCD side in the 
first sequence (Tcr - Ts - Tcf - Tr), from an intermediate 
location in the second sequence, and from an opposite 
side to the H-CCD in one sequence in Fig. 16. This al- 
lows measuring the difference in focal point between 
several locations.to perform weighting. 
[0084] Operation of one partial read cycle and the 
method of changing the read location have been ex- 
plained. Alternatively, signals at a plurality of locations 
can be read out (stored in the storage area) in one cycle. 
For example, immediately after, signals on o/2 lines are 
transferred to the storage section, the electrode of the 
storage area is changed to a high voltage (i.e., a wall 
for stopping transfer of signal charges from the image 
area is formed), pulses for a necessary number of lines 
up to the next necessary signal are applied to the elec- 
trode of the image area in order to transfer charges up 
to the next necessary o lines to the final virtual well of 
the V-CCD in the image section. Then, charges up to 
the next necessary signal are transferred to the final vir- 
tual well, and charges exceeding the overflow drain bar- 



rier are removed to the overflow drain. If ol2 transfer 
pulses are applied to the image area electrode and stor- 
age area electrode, the storage area stores signals on 
{(o/2)-1) lines in the second region next to the first o/2 

5 lines after an invalid line left after clear operation in an 
intermediate portion. If signals in three regions are to be 
stored, the second intermediate clear operation is done 
after the second signal storage, and then signals in the 
third region are stored. A larger number of storage re- 

io gjons decreases the number of storage lines at respec- 
tive portions. In this way, if data at a plurality of portions 
are read out in one cycle, AF can be realized at a higher 
speed than the above-described case of reading out da- 
ta at one portion in one cycle. 

15 [0085] Figs. 6, 7, and 8 show modifications of the lay- 
out of S1 and S2. in the above embodiment, the first and 
second phase detection rows slightly shift from each 
other. This does not pose any problem in an image sens- 
ing element of more than 100 pixels. However, these 

so modifications approximate the phase detection rows to 
the same portion. 

[0086] In Fig. 6, S1 and S2 are alternately laid out on 
the same row. In Fig. 7, S1 rows are laid out before and 
. after an S2 row. The first and second S1 rows unedergo 
25 interpolation to generate data of the S1 row correspond- 
ing to the S2 row. Fig. 8 is a modification of the layout 
in Fig. 6 in which two rows each alternately including S1 
and S2 are zigzagged. 
: ■ [0087] The pixel group for generating a phase differ- 
so, ence signal and the driving method of reading out a sig- 
nal from this portion enable high-speed, high-precision 
AF. 

[0088] In image processing of raw data (raw informa- 
tion of each pixel) of an image by actual photographing 

35 with this image sensing element, the portions S1 and 
S2 are interpolated by peripheral color pixels. This real- 
izes an image sensing element which hardly degrades 
image quality and can read distance measurement data 
in addition to a captured image. On the assumption of 

40 the interpolation, a cell of 2 x 2 pixels with three colors 
and one function can be easily interpolated and hardly 
degrades image quality. A 2 x 4 layout can also be in- 
terpolated though the S1 row is more apart from the S2 
row than in the 2 x 2 layout. 

45 [0089] The above embodiment concerns the image 
sensing element including a distance measurement pix- 
el group, and can be modified into an image sensing 
element having a pixel group for obtaining AE informa- 
tion. This modification will be described below. 

so [0090] Fig. 9 shows the openings of pixels functioning 
as AE pixels. These openings are formed from a metal 
light-shielding film similarly to the AF pixel. The AE pixel 
is different from the AF pixel in that the center of the 
opening coincides with the center of the photoelectric 

ss conversion portion. Note that the AE pixel does not al- 
ways require a microlens, unlike the AF pixel, and re- 
quires only a definite difference in sensitivity. 
[0091] When S3 has a sensitivity of 1 , S4 has a sen- 
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sitivity of 1/2 (i.e., n = 1 for 1/2 n ) ( S5 has a sensitivity of 
1/4 (i.e., n = 2 for 1/2 n ), and S6 has sensitivity of 1/8 (i. 
e., n = 3 for 1/2 n ). Pluralities of pixels S3, S4 P S5, and 
S6 are laid out in a plurality of arbitrary regions in the 
image sensing area. A shift of current exposure from a s 
proper level can be calculated from the integrated val- 
ues of the S3, S4, S5, and S6 pixel groups in the respec- 
tive regions and the integrated values of respective color 
pixels. 

[0092] By arranging a plurality of pixels having differ- 
ent openings in a plurality of regions, AE can be 
achieved at a much higher speed than an AE method of 
adjusting the output level of the image sensing element 
while adjusting the exposure level. Also in this case, if 
signal charges are read out from only a region including 
detection pixels, similarly to AF, the read time of the im- 
age sensing element can be shortened. 
[0093] The first embodiment has been described by 
exemplifying the improved full-frame CCD, but can also 
be applied to an interline CCD image sensing element, 
frame-transfer CCD image sensing element, and X-Y 
address image sensing element. 

(Second Embodiment) 

[0094] Before a description of the second embodi- 
ment, improvable points of the first embodiment will be 
explained. 

[0095] Figs. 1 7 and 1 8 are views showing the concept 
of detecting the focal point in the first embodiment. For 
descriptive convenience, S1 and S2 are arranged on the 
same plane. 

[0096] Light from a specific point on an object is split 
into a light beam (L1 ) incident on S1 via the pupil of S1 , 
and a light beam (L2) incident on S2 via the pupil of S2. 
if the camera is in an in -focus state, the two light beams 
focus on one point on the microlens surface, as shown 
in Fig. 17. The same image is exposed on S1 and S2. 
Thus, a video signal read out from the S1 row and a 
video signal read out from the S2 row coincide with each 
other. 

[0097] To the contrary, if the camera is out of focus, 
L1 and L2 cross each other at a position different from 
the microlens surface. Assume that the distance be- 
tween the microlens surface and the intersection of the 
two light beams, i.e., the defocus amount is x, the image 
on S1 and the image on S2 shift by n pixels, the sensor 
pitch is d, the distance between the centers of gravity at 
the two pupils is Daf, and the distance from the principal 
point to focal point of the lens is u. At this time, the de- 
focus amount x is given by 

x = n - d • u/Daf (1) 

Since u is assumed to be almost equal to a focal length f , 



x = n • d • tfDaf (2) 

[0098] Fig. 1 9 shows a video signal read out from the 

51 row and a video signal read out from the S2 row on 
the image sensing element. The video signal read out 
from the S1 row and the video signal read out from the 

52 row have an image, shift of n • d. The shift amount 
between the two video signals is obtained to calculate 
the defocus amount x, and the lens is moved by x to 
achieve autofocus. 

[0099] To generate this image shift, light incident on 
the lens must be split into the light beams L1 and L2 via 
two different pupils. According to this method, a focus 
detection cell having a pupil division function is formed 
on the image sensing element to divide the pupil. 
[0100] Fig. 20 shows the focus detection cell. Refer- 
ence numeral 216 denotes a microlens; 214, a light- 
shielding film; and 207, a photoelectric converter. Light 
from the photographing lens is incident on the microlens 
21 6, and the light incident on the photoelectric converter 
207 is limited to a light beam from a specific direction by 
the light-shielding film 214. The light-shielding films of 
the focus detection cells S1 and S2 are symmetrical hor- 
izontally (or vertically), as shown in Fig. 21 . One of im- 
ages formed on the sensor by light beams from two pupil 
positions symmetrical about the optical axis is photoe- 
lectrical^ converted by the S1 row, and the other is pho- 
toelectrically converted by the S2 row, thereby obtaining 
two images having different pupil positions. 
[0101] Fig. 22 shows the image sensing element. 
Color filters or focus detection light-shielding films are 
formed on the image sensing element. Reference sym- 
bol R denotes a cell having a red filter; G, a cell having 
a green filter; B, a cell having a blue filter; and S1 and 
S2, focus detection cells. 

[0102] In autofocus operation, signals are read out 
from rows including S1 and S2 in the image sensing el- 
ement, and the signals output from the image sensing 
element are A/D-converted. Images on S1 and S2 are 
formed from the obtained pixel values, and the correla- 
tion between the two images are calculated to obtain the 
image shift amount. The lens is moved in accordance 
with the obtained shift amount to achieve autofocus op- 
eration. 

[0103] In photographing, an object image is exposed 
onto the image sensing element and read out from all 
the pixels. The signals read out from the image sensing 
element are A/D-converted and input to a signal 
processing circuit. The signal processing circuit aban- 
dons pixel values read out from S1 and S2, and instead 
generates and interpolates pixel values corresponding 
to S1 and S2 from peripheral pixels. Thereafter, lumi- 
nance and color difference signals are generated, com- 
pressed, and saved as an image file in a recording me- 
dium. 

[0104] The apparatus of the first embodiment, how- 
ever, cannot use any autofocus functional cell in photo- 
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graphing, and must interpolate this portion using periph- 
eral pixel. 

[0105] In photographing a still image, interpolation is 
done after a video signal is stored in the memory. I n pho- 
tographing a moving image or operating an electronic 
viewfinder, about 30 images are repetitively read out 
from the image sensing element every second, so 
processing may not be completed within the time. 
[01 06] The second embodiment is an improvement of 
this drawback. 

[0107] Fig. 23 shows the arrangement of a solid-state 
image sensing apparatus according to the second em- 
bodiment. 

[0108] The second embodiment will exemplify an in- 
terline CCD having a complimentary color filter. Refer- 
ence numerals 501 denote pixels formed from photoe- 
lectric converters. The pixels 501 are laid out in a matrix 
on an image sensing element, and their surfaces are 
covered with color filters or focus detection filters. Ref- 
erence numeral 502 denotes a vertical transfer CCD. 
The vertical transfer CCD 502 is a 4-phase driving CCD. 
To independently read out charges from focus detection 
pixels or pixels selected in a thinning mode, vertical 
transfer pulses V1 and V3 to be applied are functionally 
divided into V1 A, V1 B, Vlaf, V3A, V3B, and V3af . These 
pulses are used for 4-phase driving together with V2 and 
V4 to transfer charges stored in respective pixels to a 
horizontal transfer CCD 503. The horizontal transler 
CCD 503 transfers the charges to an output amplifier 
504 in response to horizontal transfer pulses H1 and H2. 
The output amplifier converts the charge amount into a 
voltage and outputs the voltage to an output terminal 
505. 

[0109] Operation of the second embodiment will be 
described. This embodiment relates to read methods, 
respectively, in a still image photographing mode, thin- 
ning mode, and distance measurement mode. 
[0110] The still image photographing mode will be ex- 
plained. Figs. 24 and 27 show operation in photograph- 
ing a still image in the second embodiment. In photo- 
graphing operation, charges are read out from the first 
field shown in Fig. 24 and the second field shown in Fig. 
27, and rearranged in the memory such that the layout 
of the readout pixels coincide with the layout of the pixels 
on the image sensing element. With this operation, 
charges from all the pixels on the image sensing ele^ 
ment are transferred to the memory, to obtain a high- 
resolution video image using all the pixels on the image 
sensing element. 

[0111] A read from the first field will be described. Fig. 
24 shows the vertical transfer CCD and pixels on one 
column in the pixel matrix in Fig. 23. Figs. 25 and 26 
show vertical transfer pulses. The vertical transfer pulse 
takes three, low, intermediate, and high voltages. 
[0112] At tv1 in Fig. 25, a high voltage is applied to 
V1 A, V1 B, and Vlaf. Then, potential wells are formed in 
V1A, V1B, and Vlaf, as shown at tvl in Fig. 24. At the 
same time, the read gates of V1 A, V1B, and VTaf open, 



and charges in the photoelectric converters on a Ye-Cy 
line and Ye-S2 line in the pixel matrix move to the vertical 
transfer CCD, as shown at tv1 of Fig. 24. Fig. 24 shows 
only Ye and S2 charges. With the lapse of a time to tv2, 
5 tv3, tv4, and tv5, pulses shown in Fig. 25 are applied to 
the vertical transfer CCD, and the charges in the vertical 
transfer CCD move with movement of the potential 
wells, as shown at tv2, tv3, tv4, and tv5 in Fig. 24. 
[0113] The vertical transfer pulses shown in Fig. 26 
are applied to the vertical transfer CCD every cycle of 
one horizontal blanking period, and the charges from the 
respective lines are transferred to the horizontal transfer 
CCD in units of lines. . . 

[0114] During the horizontal transfer period, the 
charges in the horizontal transfer CCD are transferred 
to the output amplifier 504 in response to the horizontal 
transfer pulses H1 and H2. The output amplifier 504 
converts the charges into a voltage value and outputs it 
to the output terminal 505. 

[011 5] A read from the second field will be explained. 
Fig. 27 shows the vertical transfer CCD and pixels on 
one column in the pixel matrix at the same location as 
in Fig. 24. Fig. 28 shows vertical transfer pulses. 
[011 6] At tv1 in Fig. 28, an intermediate voltage is ap- 
plied to V1A, V1B, and V1af. Then, potential wells are 
formed in the vertical transfer CCD, as shown at tv1 in 
Fig. 27. Since no read gates open, no charges in the 
pixels are transferred to the vertical transfer CCD. From 
tv2 to tv3, a high voltage is applied to V3A, V3B, and 
V3af, the read gates of V3A, V3B, and V3af open, and 
charges in the photoelectric converters on an Mg-G line 
and Mg-S1 line move to the vertical transfer CCD. Volt- 
ages shown at tv4 and tv5 are applied to the vertical 
transfer CCD, and the charges in the vertical transfer 
CCD move with movement of the potential wells. 
[0117] The vertical transfer pulses shown in Fig. 26 
are applied to the vertical transfer CCD every cycle of 
one horizontal blanking period, and the charges from the 
respective lines are transferred to the horizontal transfer 
CCD in units of lines. 

[011 8] The charges on the vertical transfer CCD are 
sequentially transferred to the horizontal transfer CCD 
every horizontal blanking, and output from the output 
amplifier to the output terminal. 
[0119] As described above, the second embodiment 
reads out charges from all the pixels on the image sens- 
ing element using the two, first and second fields in the 
still image photographing mode. The first and second 
fields are alternately repeated. 
[0120] In the camera using this image sensing ele- 
ment, all charges in the first and second fields are stored 
in the memory, and S1 and S2 are interpolated. S1 is 
interpolated using data of peripheral G pixels, while S2 
is interpolated using data of peripheral Ye pixels. Pixel 
data in the memory is processed, luminance and color 
difference signals are generated, an image is com- 
pressed, and filing is done to complete photographing 
operation. 
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[0121] The thinning mode will be explained. In recent 
years, digital still cameras are developed for higher res- 
olutions, and most of image sensing elements mounted 
thereon have several million pixels, which requires a 
long time for reading out a moving image. For example, 
when 1,600,000 pixels are realized by an interline CCD 
like the one shown in Fig. 23, this CCD spends about 
1/1 5 sec for a read from 1 ,600,000 pixels, compared to 
an interline CCD in 400,000-pixel class which spends 
1/60 sec for a read from one field. 
[0122] When a digital still camera is manufactured us- 
ing this interline CCD, the number of frames of a moving 
image or viewfinder image per second decreases, re- 
sulting in poor moving image quality. Further, the digital 
still camera spends a long time for photometric opera- 
tion such as autofocus. 

[01 23] To solve this, the second embodiment sets the 
thinning mode in the image sensing element to de- 
crease the number of pixels read out per field. Note that 
the thinning method in an image sensing element is ap- 
plied by the present inventor as Japanese Patent Laid- 
Open No. 9-46715. 

[0124] Fig. 29 shows operation in the thinning mode 
in the second embodiment, and shows the vertical trans- 
fer CCD and pixels on one column in the pixel matrix at 
the same location as in Fig. 24. Fig. 30 shows vertical 
transfer pulses. 

[0125] At tv1 in Fig. 30, a high voltage is applied to 
V1 A, and an intermediate voltage is applied to V1 B and 
V1af. Then, potential wells are formed in VIA, V1 B, and 
V1af in the vertical transfer CCD, as shown at tvl in Fig. 
29. At the same time, the read gate of V1 A opens, and 
charges in the Ye photoelectric converters move to the 
vertical transfer CCD via the V1 A line. From tv2 to tv3, 
a high voltage is applied to V3A, and an intermediate 
voltage is applied to V3B and V3af. Then, the potential 
wells move, the read gate of V3A opens, and Mg charg- 
es move from the photoelectric converters on the V3A 
line to the vertical transfer.CCD. Voltages shown at tv4 
and tv5 are applied to the vertical transfer CCD to move 
the charges in the vertical transfer CCD. 
[01 26] After the charges in the photoelectric convert- 
ers have been transferred to the vertical transfer CCD, 
these charges are sequentially transferred to the hori- 
zontal transfer CCD. In the thinning mode, both the 
charge-containing well and vacant well exist, as shown 
in Fig. 29. Therefore, in transferring the charges to the 
horizontal transfer CCD, two vertical transfer pulses in 
Fig. 26 are applied to the horizontal transfer CCD every 
horizontal blanking so as to add the charge-containing 
line and vacant line in a one-to-one correspondence in 
the horizontal transfer CCD. 

[0127] Image data read out in the thinning mode do 
not include any distance measurement S1 and S2data, 
and all data are pixel data which can be used to generate 
an image. Since pixels are thinned out in a read, a 1 -field 
image can be obtained within a time 1/4 the read time 
of one still image. 



[0128] The obtained image data can be used to gen- 
erate image data for a moving image or viewfinder im- 
age without performing any pixel interpolation, unlike 
the still image photographing mode. 

$ [0129] The distance measurement mode will be ex- 
plained. Fig. 31 shows operation in the distance meas- 
urement mode in the second embodiment, and shows 
the vertical transfer CCD and pixels on one column in 
the pixel matrix at the same location as in Fig. 24. Fig. 

to 32 shows vertical transfer pulses. 

[0130] At tvl in Fig. 32, a high voltage is applied to 
Vlaf, and an intermediate voltage is applied to V1 A and 
V1 B. Then, potential wells are formed in V1 A, V1 B, and 
Vlaf in the vertical transfer CCD, as shown at tvl in Fig. 

15 31 . At the same time, the read gate of Vlaf opens, and 
charges in the distance measurement cells S1 move to 
the vertical transfer CCD via the Vlaf line. From tv2 to 
tv3, a high voltage is applied to V3af , and an intermedi- 
ate voltage is applied to V3A and V3B. Then, the poten-. 

20 tial wells move, the read gate of V3af opens, and charg- 
es.in the distance measurement cells S2 move from the 
photoelectric converters on the V3af line to the vertical 
transfer CCD. Voltages shown at tv4 and tv5 are applied 
to the vertical transfer CCD to move the charges in the 

25 vertical transfer CCD. 

[0131] After the charges in the photoelectric convert- 
ers have been transferred to the vertical transfer CCD, 
these charges are sequentially transferred to the hori- 
zontal transfer CCD. In the distance measurement 

30 mode, both the charge-containing well and vacant well 
exist, as shown in Fig. 31. Hence, in transferring the 
charges to the horizontal transfer CCD, two vertical 
transfer pulses in Fig. 26 are applied to the horizontal 
transfer CCD every horizontal blanking so as to add the 

35 ^ charge-containing line and vacant line in a one-to-one 
correspondence in the horizontal transfer CCD. 
[0132] In this manner, a read from lines including the 
distance measurement cells S1 and S2 is completed. In 
the camera, two specific lines are selected, a defocus 

40 amount is calculated from the phase difference between 
S1 and S2, and the lens is driven to complete autofocus 
operation. 

[0133] As described above, according to the second 
embodiment, read pixels in the thinning mode do not in- 
45 elude any distance measurement pixel, and charges 
can be read out from a necessary number of pixels for 
generating a moving image. 

[0134] Thus, the distance measurement pixels need 
not be interpolated. Further, pixels are thinned out to an 

so amount necessary for generating a moving image, and 
a moving image can be generated at a high speed. This 
realizes photographing of a high-quality viewfinder and 
moving image file using many frames, and also realizes 
high-speed photometric operation. 

55 [01 35] As a result, the performance of an image sens- 
ing apparatus such as a digital still camera can improve, 
and the product cost can be reduced. 
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(Third Embodiment) 

[01 36] Fig. 35 shows a solid-state image sensing ap- 
paratus according to the third embodiment. The third 
embodiment will exemplify an interline CCD having a 
primary color filter. 

[0137] In Fig. 35, reference numerals 601 denote pix- 
els formed from photoelectric converters laid out in a 
matrix. The surfaces of the pixels 601 are covered with 
primary color filters or focus detection filters. Reference 
numeral 602 denotes a vertical transfer CCD. The ver- 
tical transfer CCD 602 is a 4-phase driving CCD. To in- 
dependently read out charges from focus detection pix- 
els or pixels selected in a thinning mode, vertical transfer 
pulses V1 and V3 are functionally divided into V1 A, V1 B, 
V1C, V1D, V3A, V3B, V3C and V3D. These pulses are 
used for 4-phase driving together with V2 and V4 to 
transfer charges stored in respective pixels to a horizon- 
tal transfer CCD 603. The horizontal transfer CCD trans- 
fers the charges to an output amplifier 604 in response 
to horizontal transfer pulses H1 and H2. The output am- 
plifier converts the charge amount into a voltage and 
outputs the voltage to an output terminal 605. 
[0138] Operation of the third embodiment will be de- 
scribed. Similar to the second embodiment, the third 
embodiment relates to read methods, respectively, in a 
still image photographing mode, thinning mode, and dis- 
tance measurement mode. 

[01 39] The still image photographing mode will be ex- 
plained. Figs. 36, 37, 38, and 39 show operation in pho- 
tographing a still image in the third embodiment. In pho- 
tographing a still image, charges are read out from the 
first field shown in Fig. 36 and the second field shown 
in Fig. 38, and rearranged in the memory such that the 
layout of the readout pixels coincide with the layout of 
the pixels on the image sensing element. With this op- 
eration, charges from all the pixels on the image sensing 
element are transferred to the memory to obtain a high- 
resolution video image using all the pixels on the image 
sensing element. 

[0140] A read from the first field will be described. Fig. 
36 shows the vertical transfer CCD and pixels on one 
column in the pixel matrix in Fig. 35. Figs. 37 and 26 
show vertical transfer pulses. The vertical transfer pulse 
takes three, low, intermediate, and high voltages. 
[0141] At tv1 in Fig. 37, a high voltage is applied to 
V1A, V1B, V1C, and V1D. Then, potential wells are 
formed in V1 A, V1 B, V1 C, and V1 D, as shown at tv1 in 
Fig. 36. At the same time, the read gates of V1 A, V1 B, 
V1C, and V1D open, and charges in the photoelectric 
converters on an R-G line in the pixel matrix move to the 
vertical transfer CCD, as shown at tvl of Fig. 36. Fig. 36 
shows only R charges. With the lapse of a time to tv2, 
tv3, tv4, and tv5, pulses shown in Fig. 37 are applied to 
the vertical transfer CCD, and the charges in the vertical 
transfer CCD move with movement of the potential 
wells, as shown at tv2, tv3, tv4, and tv5 in Fig. 36. 
[0142] The vertical transfer pulses shown in Fig. 26 



are applied to the vertical transfer CCD every cycle of 
one horizontal blanking period, and the charges from the 
respective lines are transferred to the horizontal transfer 
CCD in units of lines. 

s [0143] During the horizontal transfer period, the 
charges in the horizontal transfer CCD are transferred 
to the output amplifier 604 in response to the horizontal 
transfer pulses H1 and H2. The output amplifier 604 
converts the charges into a voltage value and outputs it 

io to the output terminal 605. 

[0144] A read from the second field will be explained. 
Fig. 38 shows the vertical transfer CCD and pixels on 
one column in the pixel matrix at the same location as 
in Fig. 36. Fig. 39 shows vertical transfer pulses. 

is [0145] At tv1 in Fig. 39, an intermediate voltage is ap- 
plied to V1 A, V1B, V1C, and V1D. Then, potential wells 
are formed in the vertical transfer CCD, as shown at tv1 
in Fig. 38. Since no read gates open, no charges in the 
pixels are transferred to the vertical transfer CCD. From 

20 tv2 to tv3, a high voltage is applied to V3A, V3B, V3C, 
and V3D, the read gates of V3A, V3B, V3C, and V3D 
open, and charges in the photoelectric converters on a 
G-B line or S1/S2-B line move to the vertical transfer 
CCD. Voltages shown at tv4 and tv5 are applied to the 

25 vertical transfer CCD, and the charges in the vertical 
transfer CCD move with movement of the potential 
wells. 

[0146] . The vertical transfer pulses shown in Fig.. 26 
are applied to the vertical transfer CCD every cycle of 
30 one horizontal blanking period, and the charges from the 
respective lines are transferred to the horizontal transfer 
CCD in units of lines. 

[0147] The charges on the vertical transfer CCD are 
sequentially transferred to the horizontal transfer CCD 

35 every horizontal blanking, and output from the output 
amplifier to the output terminal. 
[0148] As described above, the third embodiment 
reads out charges from all the pixels on the image sens- 
ing element using the two fields. 

40 [0149] In the camera using this image sensing ele- 
ment, after ail charges in the first and second fields are 
transferred to the memory, SI and S2 are interpolated. 
S1 and S2 are interpolated using data of peripheral G 
pixels. Pixel data in the memory is processed, lumi- 

45 nance and color difference signals are generated, an im- 
age is compressed, and filing is performed to complete 
photographing operation. 

[0150] The thinning mode will be explained. Fig. 40 
shows operation in the thinning mode in the third em- 

50 bodiment, and shows the vertical transfer CCD and pix- 
els on one column in the pixel matrix at the same loca- 
tion as in Fig. 36. Fig. 41 shows vertical transfer pulses. 
[0151] At tvl in Fig. 41, a high voltage is applied to 
V1D, and an intermediate voltage is applied to V1A, 

55 V1 B, and V1 C. Then, potential wells are formed in V1 A, 
V1B, V1C, and V1D in the vertical transfer CCD, as 
shown at tvl in Fig. 40. At the same time, the read gate 
of V1D opens, and charges in the R photoelectric con- 
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verters move to the vertical transfer CCD via the V1 D 
line. From tv2 to tv3, a high voltage is applied to V3A, 
and an intermediate voltage is applied to V3B, V3C, and 
V3D. Then, the potential wells move, the read gate of 
V3A opens, and G charges move from the photoelectric 
converters on the V3A line to the vertical transfer CCD. 
Voltages shown at tv4 and tv5 are applied to the vertical 
transfer CCD to move the charges in the vertical transfer 
CCD. 

[0152] After the charges in the photoelectric convert- 
ers have been transferred to the vertical transfer CCD, 
these charges are sequentially transferred to the hori- 
zontal transfer CCD. In the thinning mode, both the 
charge-containing well and vacant well exist, as shown 
in Fig. 40. Therefore, in transferring the charges to the 
horizontal transfer CCD, two vertical transfer pulses in 
Fig. 26 are applied to the horizontal transfer CCD every 
horizontal blanking so as to add the charge-containing 
line and vacant line in a one-to-one correspondence in 
the horizontal transfer CCD. 

[0153] Image data read out in the thinning mode do 
not include any distance measurement S1 and S2 data, 
and all data are pixel data which can be used to generate 
an image. Since pixels are thinned out in a read, one 
moving image can be obtained within a 1/4 time, com- 
pared to the still image photographing mode. 
[0154] The obtained image data can be used to gen- 
erate image data for a moving image or viewfinder im- 
age without performing any pixel interpolation, unlike 
the still image photographing mode. 
[0155] The distance measurement mode will be ex- 
plained. Fig. 42 shows operation in the distance meas- 
urement mode in the third embodiment, and shows the 
vertical transfer CCD and pixels on one column in the 
pixel matrix at the same location as in Fig. 36. Fig. 43 
shows vertical transfer pulses. 
[01 56] At tv1 in Fig. 43, an intermediate voltage is ap- 
plied to V1 A, V1 B, V1 C, and V1 D. Then, potential wells 
are formed in V1 A, V1B, V1C, and V1D in the vertical 
transfer CCD, as shown at tv1 in Fig. 42. However, no 
read gate opens, and no charge moves to the vertical 
transfer CCD. From tv2 to tv3, a high voltage is applied 
to V3B and V3C, and an intermediate voltage is applied 
to V3A and V3D. Then, the potential wells move, the 
read gates of V3B and V3C open, and charges in the 
distance measurement cells St and S2 move from the 
photoelectric converters on the V3B and V3C lines to 
the vertical transfer CCD. Voltages shown at tv4 andtvS 
are applied to the vertical transfer CCD to move the 
charges in the vertical transfer CCD. 
[01 57] After the charges in the photoelectric convert- 
ers have been transferred to the vertical transfer CCD, 
these charges are sequentially transferred to the hori- 
zontal transfer CCD. In the distance measurement 
mode, the charge-containing well and vacant well repet- 
itively exist every third line, as shown in Fig. 42. Hence, 
in transferring the charges to the horizontal transfer 
CCD, two vertical transfer pulses in Fig. 26 are applied 



to the horizontal transfer CCD every horizontal blanking 
so as to add the charge-containing line and vacant line 
in a one-to-one correspondence in the horizontal trans- 
fer CCD. 

5 [0158] In this manner, a read from lines including the 
distance measurement cells S1 and S2 is completed. In 
the camera, two specific lines are selected, a defocus 
amount is calculated from the phase difference between 
S1 and S2, and the lens is driven to complete autofocus 

io operation. 

[0159] The second and third embodiments have ex- 
emplified the interline CCD. Even when the camera us- 
es an image sensing element capable of freely reading 
out charges from a pixel designated by an X-Y address 

is method, like a C-MOS sensor, the same effects can also 
be attained by separating a row (or column) used by a 
thinning read from a row (or column) including a dis- 
tance measurement cell. 

[0160] As described above, the third embodiment re- 
20 alizes the still image photographing mode, thinning 
mode, and distance measurement mode in the image 
sensing element having a primary color filter. Also in the 
third embodiment, read pixels in the thinning mode do 
not include any distance measurement pixel, and charg- 
es es can be read out from a necessary number of pixels 
for generating a moving image. 
[0161] Accordingly, the distance measurement pixels 
need not be interpolated. Further, pixels are thinned out 
to an amount necessary for generating a moving image, 
30 and a moving image can be generated at a high speed. 
This realizes photographing of a high-quality viewfinder 
and moving image file using many frames, and also re- 
alizes high-speed photometric operation. 
[01 62] As a result, the performance of an image sens- 
es ing apparatus such as a digital still camera can improve, 
and the product cost can be reduced. 

(Fourth Embodiment) 

40 [0163] Fig. 33 shows the arrangement of an image 
sensing apparatus according to the fourth embodiment. 
The fourth embodiment concerns a digital still camera 
using the image sensing element according to the sec- 
ond embodiment and a driving circuit for driving the im- 

45 age sensing element. 

[0164] In Fig. 33, an image sensing element 710 is 
the one described in the second embodiment. A timing 
generator 711 generates vertical transfer pulses V1A, 
V1B, V1af, V2, V3A, V3B, V3af, an V4 and horizontal 

50 transfer pulses H1 and H2 in accordance with the still 
image photographing mode, thinning mode, and dis- 
tance measurement mode by the method described in 
the second embodiment. The timing generator is con- 
nected to a microprocessor 724 via a control line, and 

ss switches the driving pulse between the still image pho- 
tographing mode, thinning mode, and distance meas- 
urement mode in accordance with an instruction from 
the microprocessor. 



14 

BNSDOCID: <EP 0981245A2J_> 



27 



EP 0 981 245 A2 



28 



[01 65] An output from the image sensing element 7 1 0 
undergoes correlation double sampling by a CDS 712, 
is adjusted in signal level by an AGC 71 3, and converted 
into a digital value by an A/D converter 714. The output 
of the A/D converter is connected to a switch 726 and 
memory controller 719. • 

[0166] A signal processing circuit 715 generates lu- 
minance/color difference image data on the basis of the 
A/D-converted output signal from the image sensing el- 
ement. A compression circuit 716 compresses the lumi- 
nance/color difference image data generated by the sig- 
nal processing circuit 715 in accordance with, e.g., a 
JPEG standard. ■ 

[0167] A memory 720 is formed from a memory ele- 
ment such as a DRAM. The memory controller 719 con- 
trols to store input data in the memory 720, or read out 
data from the memory 720 in accordance with a request 
from another block. 

[0168] An external recording medium 723 is formed 
from a nonvolatile memory element, and saves an im- 
age data file and the like. An external recording medium 
control circuit 722 controls a write/read of data in/from 
the external recording medium. 
[0169] A display 718 is formed from an LCD or the 
like, displays a photographed still image or moving im- 
age, and displays as an electronic viewfinder an object 
image incident on the image sensing element before 
photographing. 

[01 70] A photographing lens 728 can adjust its focal 
point with respect to the image sensing element in ac- 
cordance with an instruction from the microprocessor 
724. A shutter switch 725 outputs a control signal SW1 
by depression to the half stroke, a control signal SW2 
by depression to the full stroke, and a control signal SW0 
by non-depression. The shutter switch 725 is depressed 
to the half stroke in distance measurement, and de- 
pressed to the full stroke in photographing. A shutter 727 
controls light incident on the image sensing element by 
opening/closing blades. 

[0171] Fig. 34 shows the flow of operation of the digital 
still camera according to the fourth embodiment. 
[0172] In step 1 of Fig. 34, the camera is powered. 
[0173] The camera activates the electronic viewfind- 
er. In step 2, the microprocessor 724 instructs the timing 
generator by a control signal to operate in the thinning 
mode. Then, the timing generator outputs thinning mode 
driving signals, i.e., the vertical transfer pulses V1A, 
V1B, VI af, V2, V3A, V3B, V3af, and V4 and the hori- 
zontal transfer pulses H1 and H2 to the image sensing 
element in accordance with the thinning mode of the 
second embodiment. 

[0174] In step 3, the microprocessor sends a control 
signal so as to connect the switch 726 to a. An image 
exposed on the image sensing element is thinned and 
read out, as described in the second embodiment. 
When the image sensing element has 1 ,600,000 pixels, 
a read of the image is completed at 30 Irames/sec. Since 
no data is read out from the distance measurement cell, 



interpolation like in the still image photographing mode 
(to be described later) need not be executed. 
[0175] An output from the image sensing element 710 
undergoes correlation double sampling by the CDS 71 2, 

5 is adjusted in amplitude by the AGC 71 3, and converted 
into a digital value by the A/D converter 714. 
[0176] The signal processing circuit 71 5 generates lu- 
minance/color difference image data from the signal in- 
put from the A/D converter, and outputs the image data. 

io A display control circuit 717 adjusts the signal output 
timing so as to allow the display 71 8 to display the lumi- 
nance/color difference image data output from the sig- 
nal processing circuit 715, and continuously outputs the 
image data to the display 718. The display 718 repeti- 

is tively displays the input image data. As a result, an ob- 
ject image incident on the image sensing element 710 
is displayed on the display 71 8 as a moving image hav- 
ing about 30 frames/sec. 

[0177] The microprocessor adjusts the timing of an 

20 electronic shutter pulse for clearing charges in all the 
photoelectric converters on the image sensing element 
so as to optimize the exposure amount of the image 
sensing element during operation of the viewfinder. This 
achieves autoexposure. 

25 [0178] A photographer determines an object via the 
electronic viewfinder, and depresses the shutter switch 
725 to the half stroke. If the microprocessor 724 deter- 
mines in step 4 that the shutter switch 725 is in the SW1 
• state," it advances processing to step 5 to start autofocus 

30 operation. 

[01 79] In step 5, the microprocessor changes the tim- 
ing generator to the distance measurement mode. 
[0180] The timing generator switches the driving sig- 
nal to the distance measurement mode, and outputs the 

35 vertical transfer pulses V1 A, V1 B, V1 af, V2, V3A, V3B, 
V3af , and V4 and the horizontal transfer pulses H1 and 
H2 to the image sensing element in accordance with the 
distance measurement mode of the second embodi- 
ment. 

40 [0181] An output from the image sensing element 710 
undergoes correlation double sampling by the CDS 712, 
is adjusted in amplitude by the AGC 713, and converted 
into a digital value by the A/D converter 714. The mem- 
ory controller 71 9 stores outputs corresponding to one 

45 field from the A/D converter in the memory 720. 

[0182] The memory controller transfers the images of 
the distance measurement cells S1 and S2 from data in 
the memory to a phase difference calculation circuit 721 . 
The phase difference calculation circuit 721 obtains a 

50 shift amount n between the two lines by correlation cal- 
culation, and outputs the shift amount n. The microproc- 
essor reads out the shift amount n output from the phase 
difference calculation circuit 721 , calculates the defocus 
amount x from the shift amount n by equation (2), and 

55 outputs a corresponding lens driving signal to the pho- 
tographing lens 728. 

[0183] The photographing lens 728 moves in accord- 
ance with the driving signal, thereby completing autofo- 
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cus operation. 

[0184] When the photographer depresses the shutter 
switch 725 to the full stroke, the shutter switch 725 out- 
puts the control signal SW2. It the microprocessor de- 
tects the depression' of the shutter switch to the full s 
stroke in step 7, it switches the mode of the timing gen- 
erator to the still image photographing mode in step B. 
In step 9, the microprocessor switches the shutter 727 
to b. 

[0185] In the still image photographing mode, the tim- 
ing generator generates the driving pulse in the still im- 
age photographing mode of the second embodiment. 
The timing generator generates driving pulses so as to 
alternately repeat the first and second fields, and out- 
puts the vertical transfer pulses V1A, V1B, V1af, V2, 
V3A, V3B, V3af, and V4 and the horizontal transfer puls- 
es H1 and H2 to the image sensing element. Thus, the 
image sensing element alternately outputs video signals 
in the first and second fields. The microprocessor sets 
the timing of the electronic shutter pulse to the timing 
generator to adjust the exposure time. 
[0186] In step 10, the microprocessor starts capturing 
a still image. Capture of a still image is as follows. First, 
the microprocessor closes the mechanical shutter 727. 
Next, the microprocessor instructs the memory control- 
ler to receive an output from the A/D converter. The im- 
age sensing element starts outputting signals from the 
first field, as described in the second embodiment The 
memory controller receives the video signal of the first 
field from the A/D converter to store it in the memory 
720. At this time, two lines on the memory are paired, 
and the memory controller stores the video signal re- 
ceived from the A/D converter on the first line of the pair. 
[0187] After storing the video signal of the first field in 
the memory, the memory controller stores the video sig- 
nal of the second field. The memory controller stores the 
video signal of the second field in the second line of the 
pair on the memory. Consequently, the video signals of 
all the pixels on the image sensing element are stored 
in the memory with the same layout as on the image 
sensing element. 

[0188] The video signals of the distance measure- 
ment cells S1 and S2 are interpolated using peripheral 
pixels. The microprocessor determines the position of 
each distance measurement cell on the basis of the po- 
sitional pattern information of the distance measure- 
ment cell stored in a ROM incorporated in the micro- 
processor, and interpolates this portion using peripheral 
pixels. For example, the microprocessor interpolates S1 
in Fig. 23 by a known bicubic method using the values 
of peripheral G pixels. 

[0189] After that, the memory controller outputs im- 
age data in the memory to the signal processing circuit 
715. The signal processing circuit 71 5 converts the input 
image data into luminance/color difference image data, 
and performs processing such as gamma correction for 
the luminance/color difference image data. 
[0190] The signal processing circuit 715 sequentially 



outputs the processed data. The compression circuit 
716 compresses the data output from the signal 
processing circuit 715 in accordance with, e.g., a JPEG 
standard, and outputs the compressed image data. 
[0191] The memory controller 719 outputs the com- 
pressed image data to the external recording medium 
control circuit 722 to record the image data as a file on 
the external recording medium 723. 
[0192] In this fashion, photographing of a still image 
is completed. The microprocessor returns processing to 
step 2, changes the timing generator to the thinning 
mode, connects the output switch 726 to a, and starts 
activating the viewfinder. 

[0193] Photographing of a moving image will be ex- 
plained. Fig. 44 is a flow chart showing photographing 
of a moving image in the apparatus of the fourth embod- 
iment. 

[0194] In step 1 00 of Fig. 44, photographing of a mov- 
ing image is selected with a mode dial (not shown), and 
the camera is powered. In step 101 , the microprocessor 
sets the timing generator in the thinning mode in order 
to activate the viewfinder. In step 102, the microproces- 
sor connects the switch 726 to a. The display 718 dis- 
plays an image incident on the image sensing element, 
and the camera performs operation of the viewfinder. 
[01 95] In step 1 03, if the photographer depresses the 
shutter switch to the half stroke, the shutter switch 725 
outputs the signal SW1 . The microprocessor detects the 
signal SW1 and advances processing to step 104. 
[0196] jn response to this, the camera starts autofo- 
■ cus. In step 1 04, the microprocessor changes the timing 
generator to the distance measurement mode. Then, 
the timing generator switches the driving signal to the 
distance measurement mode. 
[0197] In step 105, the microprocessor starts a read 
from the distance measurement cell. An output from the 
image sensing element 710 undergoes correlation dou- 
ble sampling by the CDS 712, is adjusted in amplitude 
by the AGC 713, and converted into a digital value by 
the A/D converter 714. The memory controller 719 
stores outputs corresponding to one field from the A/D 
converter in the memory 720. 

[0198] The memory controller transfers the image of 
S2 to the phase difference calculation circuit 721, simi- 
larly to the image of the distance measurement cell S1 
stored in the memory. The microprocessor reads out the 
shift amount between the two lines from the phase dif- 
ference calculation circuit, calculates the defocus 
amount from the shift amount, and outputs a corre- 
sponding lens driving signal to the photographing lens 
728. 

[0199] The photographing lens 728 moves in accord- 
ance with the driving signal, thereby completing autofo- 
cus operation. 

[0200] In step 106, the microprocessor resets an in- 
ternal timer to 0. 

[0201] In step 107, if the photographer depresses the 
shutter switch to the full stroke, the shutter switch qui- 
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puts the signal SW2. If the microprocessor detects the 
signal SW2, it advances processing to step 1 08 to start 
capturing a moving image. 

[0202] In step 108, the microprocessor checks wheth- 
er the count value ot the timer exceeds an evaluation 
reference value. In this case, the timer evaluation refer- 
ence value is 0.2 sec. The timer count has not reached 
0.2 sec yet, and the microprocessor advances process- 
ing to step 109. 

[0203] I n step 1 09, the microprocessor sets the timing 
generator to the thinning mode. Then, the timing.gener- 
ator generates a driving pulse in the thinning mode, and 
the image sensing element 710 outputs thinned image 
data. The output from the image sensing element un- 
dergoes correlation double sampling by the CDS 712, 
is adjusted in amplitude by the AGC 71 3, and converted 
into a digital value by the A/D converter 71 4. 
[0204] The signal processing circuit 71 5 generates lu- 
minance/color difference image data from the signal in- 
put from the A/D converter, and outputs the image data. 
The output from the signal processing circuit 71 5 is input 
to the display control circuit 71 7 and compression circuit 
716. The display control circuit 717 displays the input 
luminance/color difference image data on the display 
718, similarly to the viewfinder. At the same time, the 
compression circuit 716 compresses the. input lumi- 
nance/color difference signal, and outputs the com- 
pressed signal to the memory, controller. 
[0205] The memory controller 71 9 outputs the. com- 
pressed image data to the external recording medium 
control circuit 722 to record the image data as a file on 
the external recording medium 723. 
[0206] The microprocessor returns processing to step 
107. In step 107, the microprocessor checks whether 
the shutter switch is kept in the full-stroke state or re- 
leased. While the shutter switch is depressed to the full 
stroke, the camera continues photographing a moving 
image. In this case, the shutter switch is kept in the full- 
stroke state. For this, reason, the microprocessor ad- 
vances processing to step 108. 
[0207] Instep 108, if the timer count exceeds 0.2 sec, 
the microprocessor detects this, returns processing to 
step 104, and switches the timing generator to the dis- 
tance measurement mode again to perform autofocus 
in step 105. In step 106, the microprocessor resets the 
timer. With this processing, the camera intermittently re- 
peats autofocus during photographing of a moving im- 
age, and can maintain an in-focus state even if the ob- 
ject image moves. 

[0208] If the shutter is kept in the full-stroke state in 
step 107, and the timer has not reached 0.2 sec yet in 
step 108, the microprocessor returns the timing gener- 
ator to the thinning mode again in step 109, and restarts 
capturing a moving image in step 110. If the timing gen- 
erator has already been set in the thinning mode in step 
109, the timing generator keeps operating without 
changing the current setting. 

[0209] By this loop, the camera keeps photographing 



a moving image while the shutter switch is in the full- 
stroke state, and interrupts photographing of a moving 
image every 0.2 sec to performs autofocus operation. 
[0210] Since no image data is read out from the dis- 
5 tance measurement cells S1 and S2 in capturing a mov- 
ing image, the pixels need not be interpolated, and a 
high-quality moving image using many frames can be 
photographed. 

[0211] Most digital still cameras allow a user to select 
10 the resolution of an image to be photographed. The 
fourth embodiment has already described the still image 
photographing mode in which an image can be photo- 
graphed at the highest resolution. 
[0212]. When an image is to be photographed ata low- 
is er resolution in the image sensing apparatus of the 
fourth embodiment, the timing generator is set in step 8 
not to the still image photographing mode but to the thin- 
ning mode. The same processing as in the still image 
photographing mode can be done to generate an image 
20 data file having a lower resolution. 

[021 3] Also when an image is to be photographed at 
a low resolution, no signal of the distance measurement 
cell is read out from the image sensing element, but only 
an image generation signal read out. Therefore, the dis- 
ss tance measurement cell need not be interpolated, and 
a still image can be generated within a short time. This 
increases the series photographing speed and im- 
proves the performance, of the digital still camera. . • 
[0214], .The .fourth embodiment has exemplified the 
30 image sensing element described in the second embod- 
iment. Even when the image sensing element described 
in the third embodiment or a similar image sensing ele- 
ment is employed, the same effects can be obtained by 
switching the driving pulse generated by the timing gen- 
35 erator in accordance with camera operation. 

[0215] As described above, the image sensing appa- 
ratus according to the fourth embodiment realizes high- 
speed, high-precision autofocus by using an . image 
. sensing element having an autofocus cell thereon. Al- 
40 though this image sensing apparatus employs the im- 
age sensing element having the autofocus cell thereon, 
it can display a high-quality viewfinder image using 
many frames and photograph a high-quality moving im- 
age without increasing the camera cost. Further, the im- 
45 age sensing apparatus can series-photograph still im- 
ages at a low resolution and high speed. 
[0216] An image sensing apparatus such as a digital 
still camera having these excellent effects can be real- 
ized at low cost. 

so 

(Fifth Embodiment) 

[0217] Fig. 46 shows the arrangement of an image 
sensing apparatus according to the fifth embodiment. 
55 since the most of the arrangement of the image sensing 
apparatus according to the fifth embodiment is common 
to that in the fourth embodiment, the same reference 
numerals denote the same parts, and a description 
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thereof will be omitted. 

[021 8] In the fourth embodiment, the timing generator 
711 outputs only an image sensing element driving sig- 
nal in the driving mode of reading out data from all pixels. 
To the contrary, the apparatus of the fifth embodiment 
improves the quality of a moving image or viewfinder 
image when no thinning read mode is set in the image 
sensing element. 

[021 9] Fig. 45 shows the flow of operation of a digital 
still camera according to the fifth embodiment. In step 
200 of Fig. 45, the camera is powered. 
[0220] The camera activates the electronic viewfind- 
er. In step 201, a microprocessor 724 sends a control 
signal so as to connect a switch 830 to a. 
[0221] An output from an image sensing element 710 
undergoes correlation double sampling by a CDS 712, 
is adjusted in amplitude by an AGC 71 3, and converted 
into a digital value by an A/D converter 714. 
[0222] An output from the A/D converter undergoes 
line thinning by a line thinning circuit 829. As described 
in the second and third embodiments, the image sens- 
ing element 710 is constituted by laying out a row used 
to generate an image signal in thinning and a row in- 
cluding a distance measurement cell on different lines. 
The line thinning circuit outputs only data of a row read 
out in the thinning mode shown in, e.g., Fig. 23. Thus, 
an output from the line thinning circuit 829 does not in- 
clude any output from the. distance measurement cell. 
[0223] The line thinning circuit 829 incorporates a pix- 
el rate conversion circuit using a memory, and outputs 
successive image signals. 

[0224] A signal processing circuit 715 generates lu- 
minance/color difference image data from a signal input 
from the line thinning circuit, and outputs the image data. 
A display control circuit 717 adjusts the signal output 
timing so as to allow a display 718 to display the lumi- 
nance/color difference image data output from the sig- 
nal processing circuit 71 5, and continuously outputs the 
image data to the display 718. The display 718 repeti- 
tively displays the input image data. As a result, an ob- 
ject image incident on the image sensing element 710 
is displayed on the display 71 8 as a moving image hav- 
ing about 30 frames/sec. 

[0225] The microprocessor adjusts the timing of an 
electronic shutter pulse for clearing charges in all the 
photoelectric converters on the image sensing element 
so as to optimize the exposure amount of the image 
sensing element during operation of the viewfinder. This 
achieves autoexposure. 

[0226] A photographer determines an object via the 
electronic viewfinder, and depresses a shutter switch 
725 to the naff stroke. If the microprocessor 724 deter- 
mines in step 202 that the shutter switch 725 is in the 
SW1 state, it advances processing to step 203 to start 
autofocus operation. 

[0227] In step 203, the microprocessor connects a 
switch 831 to b. In step 204, the microprocessor in- 
structs a memory controller to store outputs correspond- 



ing to one field from the A/D converter in a memory 720. 
[0228] The memory controller transfers the image of 
S2 to a phase difference calculation circuit 721 , similarly 
to the image of an distance measurement cell S1 stored 

5 in the memory. The microprocessor reads out the shift 
amount between the two lines from the phase difference 
calculation circuit, calculates the defocus amount from 
the shift amount, and outputs a corresponding lens driv- 
ing signal to a photographing lens 728. 

io [0229] The photographing lens 728 moves in accord- 
ance with the driving signal, thereby completing autofo- 
cus operation. 

[0230] If the photographer depresses the shutter 
switch 725 to the full stroke, the switch 725 outputs the 
is control signal SW2. If the microprocessor detects the 
full stroke of the shutter switch in step 205, it switches 
the switch 830 to b in step 206. 
[0231] In step 207, the microprocessor starts captur- 
ing a still image. The microprocessor closes a shutter 
727, and instructs the memory controller to receive an 
output from the A/D converter. The image sensing ele- 
ment starts outputting signals from the first field, as de- 
scribed in the second embodiment. The memory con- 
troller receives the video signal of the first field from the 
A/D converter to store it in the memory 720. At this time, 
two lines on the memory are paired, and the memory 
controller stores the video signal received from the A/D 
converter on the first line of the pair. 
[0232] After storing the video signal of the first field in 
the memory, the memory controller stores the video sig- 
nal of the second field. The memory controller stores the 
video signal of the second field in the second line of the 
pair on the memory. Consequently, the video signals of 
all the pixels on the image sensing element are stored 
in the memory with the same layout as on the image 
sensing element. 

[0233] The video signals of the distance measure- 
ment cells SI and S2 are interpolated using peripheral 
pixels. The microprocessor determines the position of 
each distance measurement cell on the basis of the po- 
sitional pattern information of the distance measure- 
ment cell stored in a ROM incorporated in the micro- 
processor, and interpolates this portion using peripheral 
pixels. For example, the microprocessor interpolates S1 
in Fig. 23 by a known bicubic method using the values 
of peripheral G pixels. 

[0234] After that, the memory controller outputs im- 
age data in the memory to the signal processing circuit 
715. The signal processing circuit 71 5 conve rts the input 
image data into luminance/color difference image data, 
and performs processing such as gamma correction for 
the luminance/color difference image data. 
[0235] The signal processing circuit 715 sequentially 
outputs the processed data. The compression circuit 
716 compresses the data output from the signal 
processing circuit 715 in accordance with, e.g., a JPEG 
standard, and outputs the compressed image data. 
[0236] The memory controller 719 outputs the com- 
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pressed image data to an external recording medium 
control circuit 722 to record the image data as a file on 
an external recording medium 723. 
[0237] In this fashion, capture of a still image is com- 
pleted. The microprocessor returns processing to step 
201 , and starts activating the viewfinder. 
[0238] Since lines including distance measurement 
cells are thinned using the line thinning circuit, the view- 
finder can operate without interpolating the distance 
measurement celt. By thinning lines including distance 
measurement cells using the line thinning circuit also in 
photographing a moving image or photographing a still 
image at a low resolution, a moving image or a still im- 
age having a low resolution can be generated at a high 
speed, similar to the fourth embodiment. 
[0239] As described above, the image sensing appa- 
ratus according to the fifth embodiment can eliminate 
interpolation of the distance measurement cell in pho- 
tographing a moving image or viewfinder image without 
using any special image sensing element driving signal 
in an image sensing apparatus using an image sensing 
element having an autofocus cell thereon. 
[0240] In the fifth embodiment, the number of frames 
is smaller than in the fourth embodiment. However, 
since no interpolation of the distance measurement cell 
need be performed, the fifth embodiment can display on 
the viewfinder and photograph a moving image while re- 
alizing tow cost and low power consumption. ln addition, 
the fifth embodiment can series-photograph still images 
at a low resolution. 

[0241] When a functional cell such as autoexposure 
cell other than the autofocus cell is arranged on the im- 
age sensing element, the same effects can be attained 
by arranging this functional cell on the same line as the 
autofocus cell. 

(Other Embodiments) 

[0242] The present invention may be applied to a sys- 
tem constituted by a plurality of devices (e.g., a host 
computer, interface device, reader, and printer) or an ap- 
paratus comprising a single device (e.g., a copying ma- 
chine or facsimile apparatus). 
[0243] The object of the present invention is realized 
even by supplying a storage medium storing software 
program codes for realizing the functions of the above- 
described embodiments to a system or apparatus, and 
causing the computer (or a CPU or MPU) of the system 
or apparatus to read out and execute the program codes 
stored in the storage medium. 
[0244] In this case, the program codes read out from 
the storage medium realize the functions of the above- 
described embodiments by themselves, and the storage 
medium storing the program codes constitutes the 
present invention.. 

[0245] As a storage medium for supplying the pro- 
gram codes, a floppy disk, hard disk, optical disk, mag- 
netooptical disk, CD-ROM, CD-R, magnetic tape, non- 



volatile memory card, ROM, or the like can be used. 
[0246] The functions of the above-described embod- 
iments are realized not only when the readout program 
codes are executed by the computer but also when the 

s OS (Operating System) running on the computer per- 
forms part or all of actual processing on the basis of the 
instructions of the program codes. 
[0247] The functions of the above-described embod- 
iments are also realized when the program codes read 

10 out from the storage medium are written in the memory 
of a function expansion board inserted into the computer 
or a function expansion unit connected to the computer, 
and the CPU of the function expansion board or function 
expansion unit performs part or all of actual processing 

is on the basis of the instructions of the program codes. 
[0248] As has been described above, according to the 
present invention, some functional pixels for distance 
measurement, photometry, and the like, other than pix- 
els for" capturing original image information, are ar- 

20 ranged in the pixels of an image sensing element. This 
arrangement allows the image sensing element to ob- 
tain AF and AE information on the original image sens- 
ing surface. The present invention can provide a com- 
pact, lower-end camera than a conventional camera 

25 having a sensor separately from an image sensing ele- 
ment. The AF and AE operation times can be shortened 
to provide a photographer more shutter chances. More- 

\ over,, high-precision AF and AE can be realized, and loss . 
of necessary-images by photographing errors can be 

30 greatly reduced. 

[0249] Still further, the present invention can realize 
an image sensing element in which read pixels in mov- 
ing image photographing or viewfinder display do not 
include any distance measurement pixel, and data can 

35 be read out from a necessary number of pixels for gen- 
erating a moving image. 

[0250] An image sensing apparatus using this image 
sensing element need not interpolate the distance 
measurement pixel, and can generate a moving image 

40 at a high speed because pixels are thinned to an amount, 
necessary for generating a moving image. Consequent- 
ly, the present invention can realize an excellent low- 
end image sensing apparatus which enables photo- 
graphing of a high-quality viewfinder or moving image 

45 file using many frames and high-speed photometric op- 
eration. 

[0251] Since processing by the image sensing appa- 
ratus is simplified, the power consumption of the appa- 
ratus reduces. 

. 50 [0252] The present invention is not limited to the 
above embodiments and various changes and modifi- 
cations can be made within the spirit and scope of the 
present invention. Therefore, to apprise the public of the 
scope of the present invention the following, claims are 
55 made. 
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Claims 

1. A solid-state Image sensing apparatus in which 
photoelectric conversion cells for converting an op- 
tical image formed by an optical system into an elec- 
trical signal are two-dimensionally laid out, charac- 
terized in that at least some of the photoelectric con- 
version cells output signals not for forming an image 
signal. 

2. The apparatus according to claim 1, characterized 
in that the signal not for forming an image signal is 
a distance measurement signal. 

3. The apparatus according to claim 1 , characterized 
in that the signal not for forming an image signal is 
a photometric signal. 

4. The apparatus according to claim 1 , characterized 
in that the photoelectric conversion cells are CCD 
elements for photoelectrical^ converting signal 
charges and transferring the photoelectrical^ con- 
verted signal charges. 

5. The apparatus according to claim 1, characterized 
in that the photoelectric conversion cells are photo- 
diodes, and a V-CCD for temporarily storing and 
transferring signal charges from the photodiodes is 
arranged along an array of the photodiodes. 

6. The apparatus according to claim 1 , characterized 
in that said solid-state image sensing apparatus 
adopts an X-Y address method. 

7. A solid-state image sensing apparatus having an 
image sensing region where photoelectric conver- 
sion cells for converting an optical image formed by 
an optical system into an electrical signal are two- 
dimensionally laid out, characterized in that the im- 
age sensing region is defined by repetition of basic 
layouts of photoelectric conversion cells for detect- 
ing a plurality of colors, and one photoelectric con- 
version cell in at least some basic layouts of the im- 
age sensing region outputs a signal not for forming 
an image signal. 

8. The apparatus according to claim 7, characterized 
in that each photoelectric conversion cell for output- 
ting a signal not for forming an image signal has a 
microlens arranged on a photoelectric conversion 
portion, and a light-shielding film which is formed 
between the microlens and the photoelectric con- 
version portion and has a specific opening, the pho- 
toelectric conversion cells are classified into first 
photoelectric conversion cells in each of which the 
opening of the light-shielding film offsets from an 
optical center of the microlens, and second photo- 
electric conversion cells in each of which the open- 



ing of the light-shielding film offsets from the optical 
center of the microlens in an opposite direction to 
the first photoelectric conversion cell, and at least 
one region of the image sensing region has a layout 
5 made up of a first row on which basic layouts includ- 
ing the first photoelectric conversion cells are 
aligned and a second row adjacent to the first row 
on which basic layouts including the second photo- 
electric conversion cells are aligned. 

10 

9. The apparatus according to claim 7, characterized 
in that each photoelectric conversion cell for output- 
ting a signal not for forming an image signal has a 
microlens arranged on a photoelectric conversion 

*5 portion, and a light-shielding film which is* formed 
between the microlens and the photoelectric con- 
version portion and has a specific opening, the pho- 
toelectric conversion cells are classified into first 
photoelectric conversion cells in each of which the 
20 opening of the light-shielding film offsets from an 
optical center of the microlens, and second photo- 
electric conversion cells in each of which the open- 
ing of the light-shielding film offsets from the optical 
center of the microlens in an opposite direction to 
25 the first photoelectric conversion cell, and at least 
one region of the image sensing region has a layout 
made up of a first row on which basic layouts includ- 
ing the first photoelectric conversion cells are 
aligned and second rows adjacent to upper and low- 
so er sides of the first row on which basic layouts in- 
cluding the second photoelectric conversion cells 
are aligned. 

10. The apparatus according to claim 7, characterized 
35 in that each photoelectric conversion cell for output- 
ting a signal not for forming an image signal has a 
microlens arranged on a photoelectric conversion 
portion, and a light-shielding film which is formed 
between the microlens and the photoelectric con- 

40 version portion and has a specific opening, the pho- 
toelectric conversion cells are classified into first 
photoelectric conversion cells in each of which the 
opening of the light-shielding film offsets from an 
optical center of the microlens, and second photo- 

45 electric conversion cells in each of which the open- 
ing of the light-shielding film offsets from the optical 
center of the microlens in an opposite direction to 
the first photoelectric conversion cell, and at least 
part of the image sensing region has a layout in 

50 which basic layouts including the first photoelectric 
conversion cells and basic layouts including the 
second photoelectric conversion cells are alternate- 
ly laid out. 

55 11. The apparatus according to claim 7, characterized 
in that each photoelectric conversion cell for output- 
ting a signal not for generating an image signal has 
a microlens arranged on a photoelectric conversion 
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portion, and a light-shielding film which is formed 
between the microlens and the photoelectric con- 
version portion and has a specific opening, the pho- 
toelectric conversion cells'are classified into first 
photoelectric conversion cells in each of which the 
opening of the light-shielding film offsets from an 
optical center of the microlens, and second photo- 
electric conversion cells in each of which the open- 
ing of the light-shielding film offsets from the optical 
center of the microlens in an opposite direction to 
the first photoelectric conversion cell, and at least 
one region of the image sensing region has a layout 
made up of a given first row on which basic layouts 
including the first.and second photoelectric conver- 
sion cells are alternately laid out, and a second row 
on which first and second basic layouts are laid out 
as opposed to a first row adjacent to the given first 
row. 

12. The apparatus according to any one of claims 7 to 
11 , characterized in that a focus of the optical sys- 
tem for forming an object image on an image sens- 
ing element is adjusted by a phase difference be- 
tween a signal output from an array of the first pho- 
toelectric conversion cells and a signal output from 
an array of the second photoelectric conversion 
cells. 

13. The apparatus according to claim 7, characterized 
in that the photoelectric conversion cell for output- 
ting a signal not for forming an image signal has a 
light-shielding film with a specific opening on a pho- 
toelectric conversion portion, and photoelectric 
conversion cells having openings with different 
opening degrees are arranged at an arbitrary loca- 
tion in the image sensing region. 

1 4. The apparatus according to claim 1 3, characterized 
in that exposure control is performed based on out- 
puts from the photoelectric conversion cells having 
different opening degrees. 

15. The apparatus according to claim 7, characterized 
in that the photoelectric conversion cells are CCD 
elements for photoelectrical converting signal 
charges and transferring the photoelectrical^ con- 
verted signal charges. 

16. The apparatus according to claim 7, characterized 
in that the photoelectric conversion cells are photo- 
diodes, and a V-CCD for temporarily storing and 
transferring signal charges from the photodiodes is 
arranged along an array of the photodiodes. 

17. The apparatus according to claim 7, characterized 
in that said solid-state image sensing apparatus 
adopts an X-Y address method. 



18. A basic layout of a photoelectric conversion cell in 
a solid-state image sensing apparatus having an 
image sensing region where photoelectric conver- 
sion cells for converting an optical image formed by 

s an optical system into an electrical signal are two- 
dimensionaffy laid out, characterized in that photo- 
electric conversion cells for detecting a plurality of 
colors, and photoelectric conversion cells for out- 
putting signals not for forming an image signal are 

10 combined. 

19. A solid-state image sensing apparatus in which 
photoelectric conversion cells for converting an op- 
tical image into an electrical signal are two-dimen- 

15 sionally laid out, characterized by comprising: 

a first photoelectric conversion cell for output- 
ting a signal for forming a two-dimensional im- 
age; 

20 a second photoelectric conversion cell for out- 

putting a signal other than the signal for forming 
the two-dimensional image; and 
switching means for switching a first read mode 
of reading out a signal including both the signal 

25 output from said first photoelectric conversion 

ce II and the signal output from said second pho- 
toelectric conversion cell, and a second read 

■ • i . : ' mode of reading out a signal including not the 
signal read out from said second photoelectric 

30 conversion cell but the signal read out from said 

first photoelectric conversion cell. 

20. The apparatus according to claim 1 9, characterized 
in that said second photoelectric conversion cell is 

35 a photoelectric conversion cell for outputting a sig- 
nal for detecting a focal point. 

21 . An image sensing apparatus characterized by com- 
prising: 

40 

a solid-state image sensing element in which 
photoelectric conversion cells for converting an 
optical image into an electrical signal are two- 
dimensionally laid out, said solid-state image 

45 sensing element having a first photoelectric 

conversion cell for outputting a signal for form- 
ing a two-dimensional image and a second 
photoelectric conversion cell for outputting a 
signal other than the signal for forming the two- 

50 dimensional image; 

a timing generator for generating a driving sig- 
nal to said solid-state image sensing element, 
said timing generator generating a first driving 
signal for outputting, from said image sensing 

55 element, a signal including both the signal out- 

put from the first photoelectric conversion cell 
and the signal output from the second photoe- 
lectric conversion cell, and a second driving 
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signal for outputting, from said image sensing 
element, a signal including not the signal read 
out from the second photoelectric conversion 
cell but the signal read out from the first photo- 
electric conversion cell; and 
switching means for switching a first photo- 
graphing mode of generating a video signal us- 
ing all pixels on said image sensing element by 
the first driving signal, and a second photo- 
graphing mode of generating a video signal by 
thinning out the pixels on said image sensing 
element by the second driving signal. 

22. The apparatus according to claim 21 , characterized 
in that the second photoelectric conversion cell is a 
photoelectric conversion cell for outputting a signal 
for detecting a focal point. 

23. The apparatus according to claim 21 , characterized 
in that said timing generator generates a third driv- 
ing signal for outputting, from said image sensing 
element, a video signal including a signal output 
from the second photoelectric conversion cell, and 
said switching means switches said timing genera- 
tor between a state of generating the second driving 
signal and a state of generating the third driving sig- 
nal every predetermined time. 

24. An image sensing apparatus characterized by com- 
prising: 

a solid-state image sensing element in. which 
photoelectric conversion cells for converting an 
optical image into an electrical signal are two- 
dimensionally laid out, said solid-state image 
sensing element having a first photoelectric 
conversion cell for outputting a signal for form- 
ing a two-dimensional image and a second 
photoelectric conversion cell for outputting a 
signal other than the signal for forming the two- 
dimensional image; 

a thinning circuit for thinning image signals eve- 
ry predetermined time; and 
switching means for switching a first photo- 
graphing mode of generating a video signal us- 
ing all pixels on said image sensing element, 
and a second photographing mode of generat- 
ing a video signal by abandoning signals output 
from the second photoelectric conversion cell 
by said thinning circuit, and thinning out the pix- 
els on said image sensing element. 

25. The apparatus according to claim 24, characterized 
in that the second photoelectric conversion cell is a 
photoelectric conversion cell for outputting a signal 
for detecting a focal point. 

26. A solid-state image sensing apparatus control 



method of controlling a solid-state image sensing 
element having a first photoelectric conversion cell 
for outputting a signal for forming a two-dimensional 
image and a second photoelectric conversion cell 

s for outputting a signal other than the signal for form- 
ing the two-dimensional image in a solid-state im- 
age sensing apparatus in which photoelectric con- 
version cells for converting an optical image into an 
electrical signal are two-dimensional ly laid out, 

to characterized by comprising: 

controlling to switch a first read mode of read- 
ing out a signal including both the signal output from 
the first photoelectric conversion cell and the signal 
output from the second photoelectric conversion 

is cell, and a second read mode of reading out a signal 
including not the signal read out from the second 
photoelectric conversion cell but the signal read out 
from the first photoelectric conversion cell. 

20 27. A storage medium storing a control program for 
controlling a solid-state image sensing element 
having a first photoelectric conversion cell for out- 
putting a signal for forming a two-dimensional im- 
age and a second photoelectric conversion cell for 
2S outputting a signal other than the signal for forming 
the two-dimensional image in a solid-state image 
sensing apparatus in which photoelectric conver- 
sion cells for converting an optical image into an 
electrical signal are two-dimensionally laid out, 
30 characterized in that the control program comprises 
a code of the step of switching a first read mode of 
reading out a signal including both the signal output 
from the first photoelectric conversion cell and the 
signal output from the second photoelectric conver- 
ts sion cell, and a second read mode of reading out a 
signal including not the signal read out from the sec- 
ond photoelectric conversion cell but the signal read 
out from the first photoelectric conversion cell. 

40 28. An image sensing apparatus characterized by com- 
prising an image sensing region where photoelec- 
tric conversion cells for converting an optical image 
into an electrical signal are two-dimensionally laid 
out, the image sensing region including a first of 

4S photoelectric conversion cells for outputting signals 
for forming image signals, and second photoelectric 
conversion cells for outputting signals not for form- 
ing an image signal. 

so 29. The apparatus according to claim 28, characterized 
by further comprising first control means for control- 
ling to read out the signals from the plurality of first 
photoelectric conversion cells and the signals from 
the second photoelectric conversion cells, and to in- 

55 terpolate the plurality of second photoelectric con- 
version cells using the signals from the plurality of 
first photoelectric conversion cells. 
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30. The apparatus according to claim 28, characterized 
by further comprising second control means tor 
controlling to perform image sensing adjustment 
using the signals output from the plurality of second 
photoelectric conversion cells, and to perform im- 5 
age formation using the signals from the plurality of 
first photoelectric conversion cells. 

31. The apparatus according to claim 30, characterized 

in that the image sensing adjustment includes focus 10 
adjustment and/or exposure adjustment. 

32. The apparatus according to claim 30, characterized 
in that the image formation is generation of a lumi- 
nance signal and chrominance signals. « 
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